# tedlium

<br />

- **Description**:

The TED-LIUM corpus is English-language TED talks, with transcriptions, sampled
at 16kHz. It contains about 118 hours of speech.

- **Additional Documentation** :
  [Explore on Papers With Code](https://paperswithcode.com/dataset/ted-lium-3)

- **Source code** :
  [`tfds.datasets.tedlium.Builder`](https://github.com/tensorflow/datasets/tree/master/tensorflow_datasets/datasets/tedlium/tedlium_dataset_builder.py)

- **Versions**:

  - **`1.0.1`** (default): No release notes.
- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  No

- **Feature structure**:

    FeaturesDict({
        'gender': ClassLabel(shape=(), dtype=int64, num_classes=3),
        'id': string,
        'speaker_id': string,
        'speech': Audio(shape=(None,), dtype=int64),
        'text': Text(shape=(), dtype=string),
    })

- **Feature documentation**:

| Feature | Class | Shape | Dtype | Description |
|---|---|---|---|---|
|   | FeaturesDict |   |   |   |
| gender | ClassLabel |   | int64 |   |
| id | Tensor |   | string |   |
| speaker_id | Tensor |   | string |   |
| speech | Audio | (None,) | int64 |   |
| text | Text |   | string |   |

- **Supervised keys** (See
  [`as_supervised` doc](https://www.tensorflow.org/datasets/api_docs/python/tfds/load#args)):
  `('speech', 'text')`

- **Figure**
  ([tfds.show_examples](https://www.tensorflow.org/datasets/api_docs/python/tfds/visualization/show_examples)):
  Not supported.

- **Citation**:

    @inproceedings{rousseau2012tedlium,
      title={TED-LIUM: an Automatic Speech Recognition dedicated corpus},
      author={Rousseau, Anthony and Del{\'e}glise, Paul and Est{\`e}ve, Yannick},
      booktitle={Conference on Language Resources and Evaluation (LREC)},
      pages={125--129},
      year={2012}
    }

## tedlium/release1 (default config)

- **Config description**: The TED-LIUM corpus is English-language TED talks,
  with transcriptions, sampled at 16kHz. It contains about 118 hours of
  speech.

      This is the TED-LIUM corpus release 1,
      licensed under Creative Commons BY-NC-ND 3.0
      (http://creativecommons.org/licenses/by-nc-nd/3.0/deed.en).

- **Homepage** : <https://www.openslr.org/7/>

- **Download size** : `19.82 GiB`

- **Dataset size** : `39.23 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,469 |
| `'train'` | 56,803 |
| `'validation'` | 591 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## tedlium/release2

- **Config description** : This is the TED-LIUM corpus release 2, licensed
  under Creative Commons BY-NC-ND 3.0
  (<http://creativecommons.org/licenses/by-nc-nd/3.0/deed.en>).

      All talks and text are property of TED Conferences LLC.

      The TED-LIUM corpus was made from audio talks and their transcriptions
      available on the TED website. We have prepared and filtered these data
      in order to train acoustic models to participate to the International
      Workshop on Spoken Language Translation 2011 (the LIUM English/French
      SLT system reached the first rank in the SLT task).

      Contains 1495 talks and transcripts.

- **Homepage** : <https://www.openslr.org/19/>

- **Download size** : `34.26 GiB`

- **Dataset size** : `67.04 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,469 |
| `'train'` | 92,973 |
| `'validation'` | 591 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>

## tedlium/release3

- **Config description**: This is the TED-LIUM corpus release 3, licensed
  under Creative Commons BY-NC-ND 3.0.

      All talks and text are property of TED Conferences LLC.

      This new TED-LIUM release was made through a collaboration between the
      Ubiqus company and the LIUM (University of Le Mans, France)

      Contents:

      - 2351 audio talks in NIST sphere format (SPH), including talks from
        TED-LIUM 2: be careful, same talks but not same audio files (only
        these audio file must be used with the TED-LIUM 3 STM files)
      - 452 hours of audio
      - 2351 aligned automatic transcripts in STM format
      - TEDLIUM 2 dev and test data: 19 TED talks in SPH format with
        corresponding manual transcriptions (cf. 'legacy' distribution below).
      - Dictionary with pronunciations (159848 entries), same file as the one
        included in TED-LIUM 2
      - Selected monolingual data for language modeling from WMT12 publicly
        available corpora: these files come from the TED-LIUM 2 release, but
        have been modified to get a tokenization more relevant for English
        language

      Two corpus distributions:
      - the legacy one, on which the dev and test datasets are the same as in
        TED-LIUM 2 (and TED-LIUM 1).
      - the 'speaker adaptation' one, especially designed for experiments on
        speaker adaptation.

- **Homepage** : <https://www.openslr.org/51/>

- **Download size** : `50.59 GiB`

- **Dataset size** : `145.67 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'test'` | 1,469 |
| `'train'` | 268,263 |
| `'validation'` | 591 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<button id="displaydataframe">Display examples...</button>