# xtreme_pawsx

<br />

- **Description**:

This dataset contains machine translations of the English PAWS training data.
The translations are provided by the XTREME benchmark and cover the following
languages:

- French
- Spanish
- German
- Chinese
- Japanese
- Korean

For further details on PAWS, see the papers: PAWS: Paraphrase Adversaries from
Word Scrambling at <https://arxiv.org/abs/1904.01130> and PAWS-X: A Cross-lingual
Adversarial Dataset for Paraphrase Identification at
<https://arxiv.org/abs/1908.11828>

For details related to XTREME, please refer to: XTREME: A Massively Multilingual
Multi-task Benchmark for Evaluating Cross-lingual Generalization at
<https://arxiv.org/abs/2003.11080>

- **Homepage** :
  <https://github.com/google-research/xtreme>

- **Source code** :
  [`tfds.text.xtreme_pawsx.XtremePawsx`](https://github.com/tensorflow/datasets/tree/master/tensorflow_datasets/text/xtreme_pawsx/xtreme_pawsx.py)

- **Versions**:

  - **`1.0.0`** (default): No release notes.
- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  Yes

- **Feature structure**:

    FeaturesDict({
        'label': ClassLabel(shape=(), dtype=int64, num_classes=2),
        'sentence1': Text(shape=(), dtype=string),
        'sentence2': Text(shape=(), dtype=string),
    })

- **Feature documentation**:

| Feature | Class | Shape | Dtype | Description |
|---|---|---|---|---|
|   | FeaturesDict |   |   |   |
| label | ClassLabel |   | int64 |   |
| sentence1 | Text |   | string |   |
| sentence2 | Text |   | string |   |

- **Supervised keys** (See
  [`as_supervised` doc](https://www.tensorflow.org/datasets/api_docs/python/tfds/load#args)):
  `None`

- **Figure**
  ([tfds.show_examples](https://www.tensorflow.org/datasets/api_docs/python/tfds/visualization/show_examples)):
  Not supported.

- **Citation**:

    @article{hu2020xtreme,
          author    = {Junjie Hu and Sebastian Ruder and Aditya Siddhant and Graham Neubig and Orhan Firat and Melvin Johnson},
          title     = {XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalization},
          journal   = {CoRR},
          volume    = {abs/2003.11080},
          year      = {2020},
          archivePrefix = {arXiv},
          eprint    = {2003.11080}
    }

## xtreme_pawsx/de (default config)

- **Config description**: Translated to de

- **Download size** : `22.34 MiB`

- **Dataset size** : `14.19 MiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 49,340 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xtreme_pawsx/es

- **Config description**: Translated to es

- **Download size** : `22.27 MiB`

- **Dataset size** : `14.09 MiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 49,244 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xtreme_pawsx/fr

- **Config description**: Translated to fr

- **Download size** : `22.70 MiB`

- **Dataset size** : `14.53 MiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 49,208 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xtreme_pawsx/ja

- **Config description**: Translated to ja

- **Download size** : `25.12 MiB`

- **Dataset size** : `16.98 MiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 49,086 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xtreme_pawsx/ko

- **Config description**: Translated to ko

- **Download size** : `22.99 MiB`

- **Dataset size** : `14.86 MiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 49,298 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## xtreme_pawsx/zh

- **Config description**: Translated to zh

- **Download size** : `21.45 MiB`

- **Dataset size** : `13.21 MiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 49,149 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>