- Description:
Eraser Multi RC is a dataset for queries over multi-line passages, along with answers and a rationalte. Each example in this dataset has the following 5 parts
- A Mutli-line Passage 2. A Query about the passage 3. An Answer to the query
- A Classification as to whether the answer is right or wrong 5. An Explanation justifying the classification
Homepage: https://cogcomp.seas.upenn.edu/multirc/
Source code:
tfds.text.EraserMultiRc
Versions:
0.1.1
(default): No release notes.
Download size:
1.59 MiB
Dataset size:
Unknown size
Auto-cached (documentation): Unknown
Splits:
Split | Examples |
---|---|
'test' |
4,848 |
'train' |
24,029 |
'validation' |
3,214 |
- Features:
FeaturesDict({
'evidences': Sequence(Text(shape=(), dtype=tf.string)),
'label': ClassLabel(shape=(), dtype=tf.int64, num_classes=2),
'passage': Text(shape=(), dtype=tf.string),
'query_and_answer': Text(shape=(), dtype=tf.string),
})
Supervised keys (See
as_supervised
doc):None
Citation:
@unpublished{eraser2019,
title = {ERASER: A Benchmark to Evaluate Rationalized NLP Models},
author = {Jay DeYoung and Sarthak Jain and Nazneen Fatema Rajani and Eric Lehman and Caiming Xiong and Richard Socher and Byron C. Wallace}
}
@inproceedings{MultiRC2018,
author = {Daniel Khashabi and Snigdha Chaturvedi and Michael Roth and Shyam Upadhyay and Dan Roth},
title = {Looking Beyond the Surface:A Challenge Set for Reading Comprehension over Multiple Sentences},
booktitle = {NAACL},
year = {2018}
}
Figure (tfds.show_examples): Not supported.
Examples (tfds.as_dataframe):