- Description:
QuALITY, a multiple-choice, long-reading comprehension dataset.
We provide only the raw version.
Homepage: https://github.com/nyu-mll/quality
Source code:
tfds.datasets.quality.Builder
Versions:
1.0.0
(default): Initial release.
Download size:
17.26 MiB
Auto-cached (documentation): Yes
Splits:
Split | Examples |
---|---|
'dev' |
230 |
'test' |
232 |
'train' |
300 |
- Feature structure:
FeaturesDict({
'article': Text(shape=(), dtype=string),
'article_id': Text(shape=(), dtype=string),
'difficults': Sequence(bool),
'gold_labels': Sequence(int32),
'options': Sequence(Sequence(Text(shape=(), dtype=string))),
'question_ids': Sequence(Text(shape=(), dtype=string)),
'questions': Sequence(Text(shape=(), dtype=string)),
'set_unique_id': Text(shape=(), dtype=string),
'source': Text(shape=(), dtype=string),
'title': Text(shape=(), dtype=string),
'topic': Text(shape=(), dtype=string),
'url': Text(shape=(), dtype=string),
'writer_id': Text(shape=(), dtype=string),
'writer_labels': Sequence(int32),
})
- Feature documentation:
Feature | Class | Shape | Dtype | Description |
---|---|---|---|---|
FeaturesDict | ||||
article | Text | string | ||
article_id | Text | string | ||
difficults | Sequence(Tensor) | (None,) | bool | |
gold_labels | Sequence(Tensor) | (None,) | int32 | |
options | Sequence(Sequence(Text)) | (None, None) | string | |
question_ids | Sequence(Text) | (None,) | string | |
questions | Sequence(Text) | (None,) | string | |
set_unique_id | Text | string | ||
source | Text | string | ||
title | Text | string | ||
topic | Text | string | ||
url | Text | string | ||
writer_id | Text | string | ||
writer_labels | Sequence(Tensor) | (None,) | int32 |
Supervised keys (See
as_supervised
doc):None
Figure (tfds.show_examples): Not supported.
Citation:
@article{pang2021quality,
title={ {QuALITY}: Question Answering with Long Input Texts, Yes!},
author={Pang, Richard Yuanzhe and Parrish, Alicia and Joshi, Nitish and Nangia, Nikita and Phang, Jason and Chen, Angelica and Padmakumar, Vishakh and Ma, Johnny and Thompson, Jana and He, He and Bowman, Samuel R.},
journal={arXiv preprint arXiv:2112.08608},
year={2021}
}
quality/raw (default config)
Config description: Raw with HTML.
Dataset size:
22.18 MiB
Examples (tfds.as_dataframe):
quality/stripped
Config description: Stripped of HTML.
Dataset size:
20.73 MiB
Examples (tfds.as_dataframe):