# xquad

<br />

- **Description**:

XQuAD (Cross-lingual Question Answering Dataset) is a benchmark dataset for
evaluating cross-lingual question answering performance. The dataset consists of
a subset of 240 paragraphs and 1190 question-answer pairs from the development
set of SQuAD v1.1 (Rajpurkar et al., 2016) together with their professional
translations into ten languages: Spanish, German, Greek, Russian, Turkish,
Arabic, Vietnamese, Thai, Chinese, and Hindi. Consequently, the dataset is
entirely parallel across 11 languages. To run XQuAD in the default zero-shot
setting, use the SQuAD v1.1 training and validation data here:
<https://www.tensorflow.org/datasets/catalog/squad>

We also include "translate-train", "translate-dev", and "translate-test" splits
for each non-English language from XTREME (Hu et al., 2020). These can be used
to run XQuAD in the "translate-train" or "translate-test" settings.

- **Additional Documentation** :
  [Explore on Papers With Code](https://paperswithcode.com/dataset/xquad)

- **Homepage** :
  <https://github.com/deepmind/xquad>

- **Source code** :
  [`tfds.question_answering.Xquad`](https://github.com/tensorflow/datasets/tree/master/tensorflow_datasets/question_answering/xquad.py)

- **Versions**:

  - **`3.0.0`** (default): Fixes issue with a number of examples where answer spans are misaligned due to context white-space removal. This change impacts roughly 14% of test examples.
- **Feature structure**:

    FeaturesDict({
        'answers': Sequence({
            'answer_start': int32,
            'text': Text(shape=(), dtype=string),
        }),
        'context': Text(shape=(), dtype=string),
        'id': string,
        'question': Text(shape=(), dtype=string),
        'title': Text(shape=(), dtype=string),
    })

- **Feature documentation**:

| Feature | Class | Shape | Dtype | Description |
|---|---|---|---|---|
|   | FeaturesDict |   |   |   |
| answers | Sequence |   |   |   |
| answers/answer_start | Tensor |   | int32 |   |
| answers/text | Text |   | string |   |
| context | Text |   | string |   |
| id | Tensor |   | string |   |
| question | Text |   | string |   |
| title | Text |   | string |   |

- **Supervised keys** (See
  [`as_supervised` doc](https://www.tensorflow.org/datasets/api_docs/python/tfds/load#args)):
  `None`

- **Figure**
  ([tfds.show_examples](https://www.tensorflow.org/datasets/api_docs/python/tfds/visualization/show_examples)):
  Not supported.

- **Citation**:

    @article{Artetxe:etal:2019,
          author    = {Mikel Artetxe and Sebastian Ruder and Dani Yogatama},
          title     = {On the cross-lingual transferability of monolingual representations},
          journal   = {CoRR},
          volume    = {abs/1910.11856},
          year      = {2019},
          archivePrefix = {arXiv},
          eprint    = {1910.11856}
    }

## xquad/ar (default config)

- **Config description**: XQuAD 'ar' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `420.97 MiB`

- **Dataset size** : `134.83 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,541 |
| `'translate-test'` | 1,151 |
| `'translate-train'` | 86,787 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/de

- **Config description**: XQuAD 'de' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `127.04 MiB`

- **Dataset size** : `98.80 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,371 |
| `'translate-test'` | 1,168 |
| `'translate-train'` | 82,603 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/el

- **Config description**: XQuAD 'el' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `499.40 MiB`

- **Dataset size** : `157.90 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes (test, translate-dev, translate-test), Only when `shuffle_files=False`
  (translate-train)

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,100 |
| `'translate-test'` | 1,182 |
| `'translate-train'` | 79,946 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/es

- **Config description**: XQuAD 'es' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `138.41 MiB`

- **Dataset size** : `104.96 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,566 |
| `'translate-test'` | 1,188 |
| `'translate-train'` | 87,488 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/hi

- **Config description**: XQuAD 'hi' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `472.23 MiB`

- **Dataset size** : `207.85 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes (test, translate-dev, translate-test), Only when `shuffle_files=False`
  (translate-train)

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,536 |
| `'translate-test'` | 1,184 |
| `'translate-train'` | 85,804 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/ru

- **Config description**: XQuAD 'ru' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `513.80 MiB`

- **Dataset size** : `159.38 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes (test, translate-dev, translate-test), Only when `shuffle_files=False`
  (translate-train)

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,469 |
| `'translate-test'` | 1,190 |
| `'translate-train'` | 84,869 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/th

- **Config description**: XQuAD 'th' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `461.54 MiB`

- **Dataset size** : `199.57 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes (test, translate-dev, translate-test), Only when `shuffle_files=False`
  (translate-train)

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,516 |
| `'translate-test'` | 1,157 |
| `'translate-train'` | 85,846 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/tr

- **Config description**: XQuAD 'tr' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `151.08 MiB`

- **Dataset size** : `97.56 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,535 |
| `'translate-test'` | 1,112 |
| `'translate-train'` | 86,511 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/vi

- **Config description**: XQuAD 'vi' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `218.09 MiB`

- **Dataset size** : `120.03 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,555 |
| `'translate-test'` | 1,178 |
| `'translate-train'` | 87,187 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/zh

- **Config description**: XQuAD 'zh' test split, with machine-translated
  translate-train/translate-dev/translate-test splits from XTREME (Hu et al.,
  2020).

- **Download size** : `174.57 MiB`

- **Dataset size** : `80.79 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |
| `'translate-dev'` | 10,475 |
| `'translate-test'` | 1,186 |
| `'translate-train'` | 85,700 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xquad/en

- **Config description**: XQuAD 'en' test split.

- **Download size** : `595.10 KiB`

- **Dataset size** : `1.19 MiB`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,190 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>