eraser_multi_rc

Description:

Eraser Multi RC is a dataset for queries over multi-line passages, along with answers and a rationalte. Each example in this dataset has the following 5 parts

A Mutli-line Passage 2. A Query about the passage 3. An Answer to the query
A Classification as to whether the answer is right or wrong 5. An Explanation justifying the classification

Homepage: https://cogcomp.seas.upenn.edu/multirc/
Source code: tfds.text.EraserMultiRc
Versions:
- 0.1.1 (default): No release notes.
Download size: 1.59 MiB
Dataset size: Unknown size
Auto-cached (documentation): Unknown
Splits:

Split	Examples
`'test'`	4,848
`'train'`	24,029
`'validation'`	3,214

Feature structure:

FeaturesDict({
    'evidences': Sequence(Text(shape=(), dtype=tf.string)),
    'label': ClassLabel(shape=(), dtype=tf.int64, num_classes=2),
    'passage': Text(shape=(), dtype=tf.string),
    'query_and_answer': Text(shape=(), dtype=tf.string),
})

Feature documentation:

Feature	Class	Shape	Dtype
	FeaturesDict
evidences	Sequence(Text)	(None,)	tf.string
label	ClassLabel		tf.int64
passage	Text		tf.string
query_and_answer	Text		tf.string

Supervised keys (See as_supervised doc): None
Figure (tfds.show_examples): Not supported.
Examples (tfds.as_dataframe):

Citation:

@unpublished{eraser2019,
    title = {ERASER: A Benchmark to Evaluate Rationalized NLP Models},
    author = {Jay DeYoung and Sarthak Jain and Nazneen Fatema Rajani and Eric Lehman and Caiming Xiong and Richard Socher and Byron C. Wallace}
}
@inproceedings{MultiRC2018,
    author = {Daniel Khashabi and Snigdha Chaturvedi and Michael Roth and Shyam Upadhyay and Dan Roth},
    title = {Looking Beyond the Surface:A Challenge Set for Reading Comprehension over Multiple Sentences},
    booktitle = {NAACL},
    year = {2018}
}