rlu_atari_checkpoints_ordered

  • Açıklama:

RL Unplugged, çevrimdışı pekiştirme öğrenimi için bir dizi testtir. RL Unplugged aşağıdaki hususlar etrafında tasarlanmıştır: kullanım kolaylığını kolaylaştırmak için veri kümelerine, genel bir işlem hattı oluşturulduktan sonra uygulamacının süitteki tüm verilerle çalışmasını kolaylaştıran birleşik bir API sağlıyoruz.

Biz tarafından tarif edilen protokol takip oyun bir geniş ve çeşitli veri kümesi serbest olan , Agarwal ve ark. 2020 birçok ayrık kullanıcı çevrimdışı RL algoritmaları değerlendirmek için kullanılabilir. Veri kümesi bir online DQN aracı çalıştıran ve yapışkan eylemlerle eğitim sırasında replay gelen geçişler kaydederek oluşturulan Machado ve ark., 2018 . Belirtildiği gibi Agarwal vd., 2020 , her oyun için 50 milyon geçişler her beş koşular verileri kullanır. 46 Atari oyunu için veri setlerini yayınlıyoruz. Veri kümesinin nasıl oluşturulduğuna ilişkin ayrıntılar için lütfen makaleye bakın.

Atari, standart bir RL kriteridir. Yaklaşımınızı ayrık eylemlerle diğer son teknoloji çevrimdışı RL yöntemleriyle karşılaştırmakla ilgileniyorsanız, Atari'de çevrimdışı RL yöntemlerini denemenizi öneririz.

Her adımın ödülünün yanı sıra, bu veri kümesi, kırpılan ödülü ([-1, 1] kırpma ile elde edilen) ve bölüm başına kırpılan ödülün toplamını içerir.

Konfigürasyonların her biri bölümlere ayrılmıştır. Bölmeler, 1M adımların kontrol noktalarına karşılık gelir (bölüm sayısının farklı olabileceğini unutmayın). Kontrol noktaları zamanında sıralanır (böylece kontrol noktası 0, kontrol noktası 1'den önce çalışır).

Her bölme içindeki bölümler sıralanır. Kontrol https://www.tensorflow.org/datasets/determinism size sırayla bölüm okumak sağlamak istiyorum.

Bu veri kümesi, DQN yeniden oynatma kağıdında kullanılana karşılık gelir. https://research.google/tools/datasets/dqn-replay/

Bölmek Örnekler
  • Özellikler:
FeaturesDict({
    'checkpoint_id': tf.int64,
    'clipped_episode_return': tf.float32,
    'episode_id': tf.int64,
    'episode_return': tf.float32,
    'steps': Dataset({
        'action': tf.int64,
        'clipped_reward': tf.float32,
        'discount': tf.float32,
        'is_first': tf.bool,
        'is_last': tf.bool,
        'is_terminal': tf.bool,
        'observation': Image(shape=(84, 84, 1), dtype=tf.uint8),
        'reward': tf.float32,
    }),
})
@misc{gulcehre2020rl,
    title={RL Unplugged: Benchmarks for Offline Reinforcement Learning},
    author={Caglar Gulcehre and Ziyu Wang and Alexander Novikov and Tom Le Paine
        and  Sergio Gómez Colmenarejo and Konrad Zolna and Rishabh Agarwal and
        Josh Merel and Daniel Mankowitz and Cosmin Paduraru and Gabriel
        Dulac-Arnold and Jerry Li and Mohammad Norouzi and Matt Hoffman and
        Ofir Nachum and George Tucker and Nicolas Heess and Nando deFreitas},
    year={2020},
    eprint={2006.13888},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

rlu_atari_checkpoints_ordered/Alien_run_1 (varsayılan yapılandırma)

rlu_atari_checkpoints_ordered/Alien_run_2

rlu_atari_checkpoints_ordered/Alien_run_3

rlu_atari_checkpoints_ordered/Alien_run_4

rlu_atari_checkpoints_ordered/Alien_run_5

rlu_atari_checkpoints_ordered/Amidar_run_1

rlu_atari_checkpoints_ordered/Amidar_run_2

rlu_atari_checkpoints_ordered/Amidar_run_3

rlu_atari_checkpoints_ordered/Amidar_run_4

rlu_atari_checkpoints_ordered/Amidar_run_5

rlu_atari_checkpoints_ordered/Assault_run_1

rlu_atari_checkpoints_ordered/Assault_run_2

rlu_atari_checkpoints_ordered/Assault_run_3

rlu_atari_checkpoints_ordered/Assault_run_4

rlu_atari_checkpoints_ordered/Assault_run_5

rlu_atari_checkpoints_ordered/Asterix_run_1

rlu_atari_checkpoints_ordered/Asterix_run_2

rlu_atari_checkpoints_ordered/Asterix_run_3

rlu_atari_checkpoints_ordered/Asterix_run_4

rlu_atari_checkpoints_ordered/Asterix_run_5

rlu_atari_checkpoints_ordered/Atlantis_run_1

rlu_atari_checkpoints_ordered/Atlantis_run_2

rlu_atari_checkpoints_ordered/Atlantis_run_3

rlu_atari_checkpoints_ordered/Atlantis_run_4

rlu_atari_checkpoints_ordered/Atlantis_run_5

rlu_atari_checkpoints_ordered/BankHeist_run_1

rlu_atari_checkpoints_ordered/BankHeist_run_2

rlu_atari_checkpoints_ordered/BankHeist_run_3

rlu_atari_checkpoints_ordered/BankHeist_run_4

rlu_atari_checkpoints_ordered/BankHeist_run_5

rlu_atari_checkpoints_ordered/BattleZone_run_1

rlu_atari_checkpoints_ordered/BattleZone_run_2

rlu_atari_checkpoints_ordered/BattleZone_run_3

rlu_atari_checkpoints_ordered/BattleZone_run_4

rlu_atari_checkpoints_ordered/BattleZone_run_5

rlu_atari_checkpoints_ordered/BeamRider_run_1

rlu_atari_checkpoints_ordered/BeamRider_run_2

rlu_atari_checkpoints_ordered/BeamRider_run_3

rlu_atari_checkpoints_ordered/BeamRider_run_4

rlu_atari_checkpoints_ordered/BeamRider_run_5

rlu_atari_checkpoints_ordered/Boxing_run_1

rlu_atari_checkpoints_ordered/Boxing_run_2

rlu_atari_checkpoints_ordered/Boxing_run_3

rlu_atari_checkpoints_ordered/Boxing_run_4

rlu_atari_checkpoints_ordered/Boxing_run_5

rlu_atari_checkpoints_ordered/Breakout_run_1

rlu_atari_checkpoints_ordered/Breakout_run_2

rlu_atari_checkpoints_ordered/Breakout_run_3

rlu_atari_checkpoints_ordered/Breakout_run_4

rlu_atari_checkpoints_ordered/Breakout_run_5

rlu_atari_checkpoints_ordered/Carnival_run_1

rlu_atari_checkpoints_ordered/Carnival_run_2

rlu_atari_checkpoints_ordered/Carnival_run_3

rlu_atari_checkpoints_ordered/Carnival_run_4

rlu_atari_checkpoints_ordered/Carnival_run_5

rlu_atari_checkpoints_ordered/Centipede_run_1

rlu_atari_checkpoints_ordered/Centipede_run_2

rlu_atari_checkpoints_ordered/Centipede_run_3

rlu_atari_checkpoints_ordered/Centipede_run_4

rlu_atari_checkpoints_ordered/Centipede_run_5

rlu_atari_checkpoints_ordered/ChopperCommand_run_1

rlu_atari_checkpoints_ordered/ChopperCommand_run_2

rlu_atari_checkpoints_ordered/ChopperCommand_run_3

rlu_atari_checkpoints_ordered/ChopperCommand_run_4

rlu_atari_checkpoints_ordered/ChopperCommand_run_5

rlu_atari_checkpoints_ordered/CrazyClimber_run_1

rlu_atari_checkpoints_ordered/CrazyClimber_run_2

rlu_atari_checkpoints_ordered/CrazyClimber_run_3

rlu_atari_checkpoints_ordered/CrazyClimber_run_4

rlu_atari_checkpoints_ordered/CrazyClimber_run_5

rlu_atari_checkpoints_ordered/DemonAttack_run_1

rlu_atari_checkpoints_ordered/DemonAttack_run_2

rlu_atari_checkpoints_ordered/DemonAttack_run_3

rlu_atari_checkpoints_ordered/DemonAttack_run_4

rlu_atari_checkpoints_ordered/DemonAttack_run_5

rlu_atari_checkpoints_ordered/DoubleDunk_run_1

rlu_atari_checkpoints_ordered/DoubleDunk_run_2

rlu_atari_checkpoints_ordered/DoubleDunk_run_3

rlu_atari_checkpoints_ordered/DoubleDunk_run_4

rlu_atari_checkpoints_ordered/DoubleDunk_run_5

rlu_atari_checkpoints_ordered/Enduro_run_1

rlu_atari_checkpoints_ordered/Enduro_run_2

rlu_atari_checkpoints_ordered/Enduro_run_3

rlu_atari_checkpoints_ordered/Enduro_run_4

rlu_atari_checkpoints_ordered/Enduro_run_5

rlu_atari_checkpoints_ordered/FishingDerby_run_1

rlu_atari_checkpoints_ordered/FishingDerby_run_2

rlu_atari_checkpoints_ordered/FishingDerby_run_3

rlu_atari_checkpoints_ordered/FishingDerby_run_4

rlu_atari_checkpoints_ordered/FishingDerby_run_5

rlu_atari_checkpoints_ordered/Freeway_run_1

rlu_atari_checkpoints_ordered/Freeway_run_2

rlu_atari_checkpoints_ordered/Freeway_run_3

rlu_atari_checkpoints_ordered/Freeway_run_4

rlu_atari_checkpoints_ordered/Freeway_run_5

rlu_atari_checkpoints_ordered/Frostbite_run_1

rlu_atari_checkpoints_ordered/Frostbite_run_2

rlu_atari_checkpoints_ordered/Frostbite_run_3

rlu_atari_checkpoints_ordered/Frostbite_run_4

rlu_atari_checkpoints_ordered/Frostbite_run_5

rlu_atari_checkpoints_ordered/Gopher_run_1

rlu_atari_checkpoints_ordered/Gopher_run_2

rlu_atari_checkpoints_ordered/Gopher_run_3

rlu_atari_checkpoints_ordered/Gopher_run_4

rlu_atari_checkpoints_ordered/Gopher_run_5

rlu_atari_checkpoints_ordered/Gravitar_run_1

rlu_atari_checkpoints_ordered/Gravitar_run_2

rlu_atari_checkpoints_ordered/Gravitar_run_3

rlu_atari_checkpoints_ordered/Gravitar_run_4

rlu_atari_checkpoints_ordered/Gravitar_run_5

rlu_atari_checkpoints_ordered/Hero_run_1

rlu_atari_checkpoints_ordered/Hero_run_2

rlu_atari_checkpoints_ordered/Hero_run_3

rlu_atari_checkpoints_ordered/Hero_run_4

rlu_atari_checkpoints_ordered/Hero_run_5

rlu_atari_checkpoints_ordered/IceHockey_run_1

rlu_atari_checkpoints_ordered/IceHockey_run_2

rlu_atari_checkpoints_ordered/IceHockey_run_3

rlu_atari_checkpoints_ordered/IceHockey_run_4

rlu_atari_checkpoints_ordered/IceHockey_run_5

rlu_atari_checkpoints_ordered/Jamesbond_run_1

rlu_atari_checkpoints_ordered/Jamesbond_run_2

rlu_atari_checkpoints_ordered/Jamesbond_run_3

rlu_atari_checkpoints_ordered/Jamesbond_run_4

rlu_atari_checkpoints_ordered/Jamesbond_run_5

rlu_atari_checkpoints_ordered/Kangaroo_run_1

rlu_atari_checkpoints_ordered/Kangaroo_run_2

rlu_atari_checkpoints_ordered/Kangaroo_run_3

rlu_atari_checkpoints_ordered/Kangaroo_run_4

rlu_atari_checkpoints_ordered/Kangaroo_run_5

rlu_atari_checkpoints_ordered/Krull_run_1

rlu_atari_checkpoints_ordered/Krull_run_2

rlu_atari_checkpoints_ordered/Krull_run_3

rlu_atari_checkpoints_ordered/Krull_run_4

rlu_atari_checkpoints_ordered/Krull_run_5

rlu_atari_checkpoints_ordered/KungFuMaster_run_1

rlu_atari_checkpoints_ordered/KungFuMaster_run_2

rlu_atari_checkpoints_ordered/KungFuMaster_run_3

rlu_atari_checkpoints_ordered/KungFuMaster_run_4

rlu_atari_checkpoints_ordered/KungFuMaster_run_5

rlu_atari_checkpoints_ordered/MsPacman_run_1

rlu_atari_checkpoints_ordered/MsPacman_run_2

rlu_atari_checkpoints_ordered/MsPacman_run_3

rlu_atari_checkpoints_ordered/MsPacman_run_4

rlu_atari_checkpoints_ordered/MsPacman_run_5

rlu_atari_checkpoints_ordered/NameThisGame_run_1

rlu_atari_checkpoints_ordered/NameThisGame_run_2

rlu_atari_checkpoints_ordered/NameThisGame_run_3

rlu_atari_checkpoints_ordered/NameThisGame_run_4

rlu_atari_checkpoints_ordered/NameThisGame_run_5

rlu_atari_checkpoints_ordered/Phoenix_run_1

rlu_atari_checkpoints_ordered/Phoenix_run_2

rlu_atari_checkpoints_ordered/Phoenix_run_3

rlu_atari_checkpoints_ordered/Phoenix_run_4

rlu_atari_checkpoints_ordered/Phoenix_run_5

rlu_atari_checkpoints_ordered/Pong_run_1

rlu_atari_checkpoints_ordered/Pong_run_2

rlu_atari_checkpoints_ordered/Pong_run_3

rlu_atari_checkpoints_ordered/Pong_run_4

rlu_atari_checkpoints_ordered/Pong_run_5

rlu_atari_checkpoints_ordered/Pooyan_run_1

rlu_atari_checkpoints_ordered/Pooyan_run_2

rlu_atari_checkpoints_ordered/Pooyan_run_3

rlu_atari_checkpoints_ordered/Pooyan_run_4

rlu_atari_checkpoints_ordered/Pooyan_run_5

rlu_atari_checkpoints_ordered/Qbert_run_1

rlu_atari_checkpoints_ordered/Qbert_run_2

rlu_atari_checkpoints_ordered/Qbert_run_3

rlu_atari_checkpoints_ordered/Qbert_run_4

rlu_atari_checkpoints_ordered/Qbert_run_5

rlu_atari_checkpoints_ordered/Riverraid_run_1

rlu_atari_checkpoints_ordered/Riverraid_run_2

rlu_atari_checkpoints_ordered/Riverraid_run_3

rlu_atari_checkpoints_ordered/Riverraid_run_4

rlu_atari_checkpoints_ordered/Riverraid_run_5

rlu_atari_checkpoints_ordered/RoadRunner_run_1

rlu_atari_checkpoints_ordered/RoadRunner_run_2

rlu_atari_checkpoints_ordered/RoadRunner_run_3

rlu_atari_checkpoints_ordered/RoadRunner_run_4

rlu_atari_checkpoints_ordered/RoadRunner_run_5

rlu_atari_checkpoints_ordered/Robotank_run_1

rlu_atari_checkpoints_ordered/Robotank_run_2

rlu_atari_checkpoints_ordered/Robotank_run_3

rlu_atari_checkpoints_ordered/Robotank_run_4

rlu_atari_checkpoints_ordered/Robotank_run_5

rlu_atari_checkpoints_ordered/Seaquest_run_1

rlu_atari_checkpoints_ordered/Seaquest_run_2

rlu_atari_checkpoints_ordered/Seaquest_run_3

rlu_atari_checkpoints_ordered/Seaquest_run_4

rlu_atari_checkpoints_ordered/Seaquest_run_5

rlu_atari_checkpoints_ordered/SpaceInvaders_run_1

rlu_atari_checkpoints_ordered/SpaceInvaders_run_2

rlu_atari_checkpoints_ordered/SpaceInvaders_run_3

rlu_atari_checkpoints_ordered/SpaceInvaders_run_4

rlu_atari_checkpoints_ordered/SpaceInvaders_run_5

rlu_atari_checkpoints_ordered/StarGunner_run_1

rlu_atari_checkpoints_ordered/StarGunner_run_2

rlu_atari_checkpoints_ordered/StarGunner_run_3

rlu_atari_checkpoints_ordered/StarGunner_run_4

rlu_atari_checkpoints_ordered/StarGunner_run_5

rlu_atari_checkpoints_ordered/TimePilot_run_1

rlu_atari_checkpoints_ordered/TimePilot_run_2

rlu_atari_checkpoints_ordered/TimePilot_run_3

rlu_atari_checkpoints_ordered/TimePilot_run_4

rlu_atari_checkpoints_ordered/TimePilot_run_5

rlu_atari_checkpoints_ordered/UpNDown_run_1

rlu_atari_checkpoints_ordered/UpNDown_run_2

rlu_atari_checkpoints_ordered/UpNDown_run_3

rlu_atari_checkpoints_ordered/UpNDown_run_4

rlu_atari_checkpoints_ordered/UpNDown_run_5

rlu_atari_checkpoints_ordered/VideoPinball_run_1

rlu_atari_checkpoints_ordered/VideoPinball_run_2

rlu_atari_checkpoints_ordered/VideoPinball_run_3

rlu_atari_checkpoints_ordered/VideoPinball_run_4

rlu_atari_checkpoints_ordered/VideoPinball_run_5

rlu_atari_checkpoints_ordered/WizardOfWor_run_1

rlu_atari_checkpoints_ordered/WizardOfWor_run_2

rlu_atari_checkpoints_ordered/WizardOfWor_run_3

rlu_atari_checkpoints_ordered/WizardOfWor_run_4

rlu_atari_checkpoints_ordered/WizardOfWor_run_5

rlu_atari_checkpoints_ordered/YarsRevenge_run_1

rlu_atari_checkpoints_ordered/YarsRevenge_run_2

rlu_atari_checkpoints_ordered/YarsRevenge_run_3

rlu_atari_checkpoints_ordered/YarsRevenge_run_4

rlu_atari_checkpoints_ordered/YarsRevenge_run_5

rlu_atari_checkpoints_ordered/Zaxxon_run_1

rlu_atari_checkpoints_ordered/Zaxxon_run_2

rlu_atari_checkpoints_ordered/Zaxxon_run_3

rlu_atari_checkpoints_ordered/Zaxxon_run_4

rlu_atari_checkpoints_ordered/Zaxxon_run_5