<br />

- **Description**:

RL Unplugged is suite of benchmarks for offline reinforcement learning. The RL
Unplugged is designed around the following considerations: to facilitate ease of
use, we provide the datasets with a unified API which makes it easy for the
practitioner to work with all data in the suite once a general pipeline has been
established.

The datasets follow the [RLDS format](https://github.com/google-research/rlds)
to represent steps and episodes.

DeepMind Lab dataset has several levels from the challenging, partially
observable [Deepmind Lab suite](https://github.com/deepmind/lab). DeepMind Lab
dataset is collected by training distributed R2D2 by
[Kapturowski et al., 2018](https://openreview.net/forum?id=r1lyTjAqYX) agents
from scratch on individual tasks. We recorded the experience across all actors
during entire training runs a few times for every task. The details of the
dataset generation process is described in
[Gulcehre et al., 2021](https://arxiv.org/abs/2103.09575).

We release datasets for five different DeepMind Lab levels:
`seekavoid_arena_01`, `explore_rewards_few`, `explore_rewards_many`,
`rooms_watermaze`, `rooms_select_nonmatching_object`. We also release the
snapshot datasets for `seekavoid_arena_01` level that we generated the datasets
from a trained R2D2 snapshot with different levels of epsilons for the
epsilon-greedy algorithm when evaluating the agent in the environment.

DeepMind Lab dataset is fairly large-scale. We recommend you to try it if you
are interested in large-scale offline RL models with memory.

- **Homepage** :
  <https://github.com/deepmind/deepmind-research/tree/master/rl_unplugged>

- **Source code** :
  [`tfds.rl_unplugged.rlu_dmlab_seekavoid_arena01.RluDmlabSeekavoidArena01`](https://github.com/tensorflow/datasets/tree/master/tensorflow_datasets/rl_unplugged/rlu_dmlab_seekavoid_arena01/rlu_dmlab_seekavoid_arena01.py)

- **Versions**:

  - `1.0.0`: Initial release.
  - `1.1.0`: Added is_last.
  - **`1.2.0`** (default): BGR -\> RGB fix for pixel observations.
- **Download size** : `Unknown size`

- **Auto-cached**
  ([documentation](https://www.tensorflow.org/datasets/performances#auto-caching)):
  No

- **Feature structure**:

    FeaturesDict({
        'episode_id': int64,
        'episode_return': float32,
        'steps': Dataset({
            'action': int64,
            'discount': float32,
            'is_first': bool,
            'is_last': bool,
            'is_terminal': bool,
            'observation': FeaturesDict({
                'last_action': int64,
                'last_reward': float32,
                'pixels': Image(shape=(72, 96, 3), dtype=uint8),
            }),
            'reward': float32,
        }),
    })

- **Feature documentation**:

| Feature | Class | Shape | Dtype | Description |
|---|---|---|---|---|
|   | FeaturesDict |   |   |   |
| episode_id | Tensor |   | int64 |   |
| episode_return | Tensor |   | float32 |   |
| steps | Dataset |   |   |   |
| steps/action | Tensor |   | int64 |   |
| steps/discount | Tensor |   | float32 |   |
| steps/is_first | Tensor |   | bool |   |
| steps/is_last | Tensor |   | bool |   |
| steps/is_terminal | Tensor |   | bool |   |
| steps/observation | FeaturesDict |   |   |   |
| steps/observation/last_action | Tensor |   | int64 |   |
| steps/observation/last_reward | Tensor |   | float32 |   |
| steps/observation/pixels | Image | (72, 96, 3) | uint8 |   |
| steps/reward | Tensor |   | float32 |   |

- **Supervised keys** (See
  [`as_supervised` doc](https://www.tensorflow.org/datasets/api_docs/python/tfds/load#args)):
  `None`

- **Figure**
  ([tfds.show_examples](https://www.tensorflow.org/datasets/api_docs/python/tfds/visualization/show_examples)):
  Not supported.

- **Citation**:

    @article{gulcehre2021rbve,
        title={Regularized Behavior Value Estimation},
        author={ {\c{C} }aglar G{\"{u} }l{\c{c} }ehre and
                   Sergio G{\'{o} }mez Colmenarejo and
                   Ziyu Wang and
                   Jakub Sygnowski and
                   Thomas Paine and
                   Konrad Zolna and
                   Yutian Chen and
                   Matthew W. Hoffman and
                   Razvan Pascanu and
                   Nando de Freitas},
        year={2021},
        journal   = {CoRR},
        url       = {https://arxiv.org/abs/2103.09575},
        eprint={2103.09575},
        archivePrefix={arXiv},
    }

## rlu_dmlab_seekavoid_arena01/training_0 (default config)

- **Dataset size** : `356.86 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 134,707 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_960fc47ee04c7e918dd3cd7dc6ccd0cd408417efc6f244089c3b8026fbbce3cd.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>

## rlu_dmlab_seekavoid_arena01/training_1

- **Dataset size** : `337.09 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 128,472 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_95ec77494aa19de490d71fcfd718b5f138c3a3156e4687bd23efcaa53cb66460.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>

## rlu_dmlab_seekavoid_arena01/training_2

- **Dataset size** : `355.62 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 133,545 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_7ae71e574bca3c3cdcff75c2c448680b1fd03446d68919a75df7566573f69fb2.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>

## rlu_dmlab_seekavoid_arena01/snapshot_0_eps_0.0

- **Dataset size** : `89.16 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 33,340 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_2476d2ca611585e6ebeab3505f1a018d39d3bf302877054324412a8a5cc00707.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>

## rlu_dmlab_seekavoid_arena01/snapshot_1_eps_0.0

- **Dataset size** : `89.03 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 33,340 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_e411294648f4af6072ec47bd6231bd4dec6c82290bd89ce32e8c37897b2b6ac8.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>

## rlu_dmlab_seekavoid_arena01/snapshot_0_eps_0.01

- **Dataset size** : `89.12 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 33,340 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_cb3c58ca49f35a1a664ce082886aeba98146f5f39ceee49e4eb0d6aab154dbe1.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>

## rlu_dmlab_seekavoid_arena01/snapshot_1_eps_0.01

- **Dataset size** : `89.02 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 33,340 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_b7cf078d6aba3e762d1821dd257ce64af7d3be19a6f276d5138ac3fbc31fd341.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>

## rlu_dmlab_seekavoid_arena01/snapshot_0_eps_0.25

- **Dataset size** : `88.57 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 33,340 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_bf1cc61e2fa1073f80d5f79cbf43b16e9c6d3e848bb0bf786905469c3035fb17.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>

## rlu_dmlab_seekavoid_arena01/snapshot_1_eps_0.25

- **Dataset size** : `88.51 GiB`

- **Splits**:

| Split | Examples |
|---|---|
| `'train'` | 33,340 |

- **Examples** ([tfds.as_dataframe](https://www.tensorflow.org/datasets/api_docs/python/tfds/as_dataframe)):

<iframe src="https:///frame/datasets/catalog/rlu_dmlab_seekavoid_arena01_bd67d442652fd819c46b5e502bc956cb97e4dc762519d7660bee92af3b758d17.frame" class="framebox inherit-locale " allow="clipboard-write https://" allowfullscreen is-upgraded></iframe>