rlu_atari_checkpoints_ordered

  • תיאור:

RL Unplugged היא חבילת אמות מידה ללימוד חיזוק לא מקוון. ה-RL Unplugged מתוכנן סביב השיקולים הבאים: כדי להקל על השימוש, אנו מספקים למערכי הנתונים API מאוחד אשר מקל על המתרגל לעבוד עם כל הנתונים בחבילה לאחר הקמת צינור כללי.

אנחנו משחררים במערך גדול ומגוון של משחק בעקבות הפרוטוקול שתואר על ידי אגרוול et al., 2020 , אשר ניתן להשתמש בם כדי להעריך אלגוריתמי RL מחוברים דיסקרטיים מספר. מערך נתון שנוצרו על ידי הפעלת סוכן DQN באינטרנט והקלטת מעברים מן החוזר שלה במהלך אימון עם פעולות דביקות מצ'אדו et al., 2018 . כאמור אגרוול et al., 2020 , עבור כל משחק אנו משתמשים בנתונים חמש ריצות עם 50 מיליון מעברים בכל. אנו משחררים מערכי נתונים עבור 46 משחקי Atari. לפרטים על אופן יצירת מערך הנתונים, עיין במאמר.

Atari הוא רף RL סטנדרטי. אנו ממליצים לך לנסות שיטות RL לא מקוונות ב-Atari אם אתה מעוניין להשוות את הגישה שלך לשיטות RL לא מקוונות מתקדמות אחרות עם פעולות דיסקרטיות.

מלבד התגמול של כל שלב, מערך נתונים זה כולל את התגמול הקצוץ (שהושג עם [-1, 1] חיתוך) ואת סכום התגמול הקצוץ לפרק.

כל אחת מהתצורות מחולקת לפיצולים. פיצולים תואמים לנקודות ביקורת של מיליון שלבים (שימו לב שמספר הפרקים עשוי להשתנות). מחסומים מסודרים בזמן (לכן מחסום 0 רץ לפני מחסום 1).

פרקים בתוך כל פיצול מסודרים. בדוק https://www.tensorflow.org/datasets/determinism אם אתה רוצה לוודא כי אתם קוראים פרקים בסדר.

מערך נתונים זה מתאים לזה המשמש בנייר השידור החוזר של DQN. https://research.google/tools/datasets/dqn-replay/

לְפַצֵל דוגמאות
  • מאפיינים:
FeaturesDict({
    'checkpoint_id': tf.int64,
    'clipped_episode_return': tf.float32,
    'episode_id': tf.int64,
    'episode_return': tf.float32,
    'steps': Dataset({
        'action': tf.int64,
        'clipped_reward': tf.float32,
        'discount': tf.float32,
        'is_first': tf.bool,
        'is_last': tf.bool,
        'is_terminal': tf.bool,
        'observation': Image(shape=(84, 84, 1), dtype=tf.uint8),
        'reward': tf.float32,
    }),
})
@misc{gulcehre2020rl,
    title={RL Unplugged: Benchmarks for Offline Reinforcement Learning},
    author={Caglar Gulcehre and Ziyu Wang and Alexander Novikov and Tom Le Paine
        and  Sergio Gómez Colmenarejo and Konrad Zolna and Rishabh Agarwal and
        Josh Merel and Daniel Mankowitz and Cosmin Paduraru and Gabriel
        Dulac-Arnold and Jerry Li and Mohammad Norouzi and Matt Hoffman and
        Ofir Nachum and George Tucker and Nicolas Heess and Nando deFreitas},
    year={2020},
    eprint={2006.13888},
    archivePrefix={arXiv},
    primaryClass={cs.LG}
}

rlu_atari_checkpoints_ordered/Alien_run_1 (תצורת ברירת המחדל)

rlu_atari_checkpoints_ordered/Alien_run_2

rlu_atari_checkpoints_ordered/Alien_run_3

rlu_atari_checkpoints_ordered/Alien_run_4

rlu_atari_checkpoints_ordered/Alien_run_5

rlu_atari_checkpoints_ordered/Amidar_run_1

rlu_atari_checkpoints_ordered/Amidar_run_2

rlu_atari_checkpoints_ordered/Amidar_run_3

rlu_atari_checkpoints_ordered/Amidar_run_4

rlu_atari_checkpoints_ordered/Amidar_run_5

rlu_atari_checkpoints_ordered/Assault_run_1

rlu_atari_checkpoints_ordered/Assault_run_2

rlu_atari_checkpoints_ordered/Assault_run_3

rlu_atari_checkpoints_ordered/Assault_run_4

rlu_atari_checkpoints_ordered/Assault_run_5

rlu_atari_checkpoints_ordered/Asterix_run_1

rlu_atari_checkpoints_ordered/Asterix_run_2

rlu_atari_checkpoints_ordered/Asterix_run_3

rlu_atari_checkpoints_ordered/Asterix_run_4

rlu_atari_checkpoints_ordered/Asterix_run_5

rlu_atari_checkpoints_ordered/Atlantis_run_1

rlu_atari_checkpoints_ordered/Atlantis_run_2

rlu_atari_checkpoints_ordered/Atlantis_run_3

rlu_atari_checkpoints_ordered/Atlantis_run_4

rlu_atari_checkpoints_ordered/Atlantis_run_5

rlu_atari_checkpoints_ordered/BankHeist_run_1

rlu_atari_checkpoints_ordered/BankHeist_run_2

rlu_atari_checkpoints_ordered/BankHeist_run_3

rlu_atari_checkpoints_ordered/BankHeist_run_4

rlu_atari_checkpoints_ordered/BankHeist_run_5

rlu_atari_checkpoints_ordered/BattleZone_run_1

rlu_atari_checkpoints_ordered/BattleZone_run_2

rlu_atari_checkpoints_ordered/BattleZone_run_3

rlu_atari_checkpoints_ordered/BattleZone_run_4

rlu_atari_checkpoints_ordered/BattleZone_run_5

rlu_atari_checkpoints_ordered/BeamRider_run_1

rlu_atari_checkpoints_ordered/BeamRider_run_2

rlu_atari_checkpoints_ordered/BeamRider_run_3

rlu_atari_checkpoints_ordered/BeamRider_run_4

rlu_atari_checkpoints_ordered/BeamRider_run_5

rlu_atari_checkpoints_ordered/Boxing_run_1

rlu_atari_checkpoints_ordered/Boxing_run_2

rlu_atari_checkpoints_ordered/Boxing_run_3

rlu_atari_checkpoints_ordered/Boxing_run_4

rlu_atari_checkpoints_ordered/Boxing_run_5

rlu_atari_checkpoints_ordered/Breakout_run_1

rlu_atari_checkpoints_ordered/Breakout_run_2

rlu_atari_checkpoints_ordered/Breakout_run_3

rlu_atari_checkpoints_ordered/Breakout_run_4

rlu_atari_checkpoints_ordered/Breakout_run_5

rlu_atari_checkpoints_ordered/Carnival_run_1

rlu_atari_checkpoints_ordered/Carnival_run_2

rlu_atari_checkpoints_ordered/Carnival_run_3

rlu_atari_checkpoints_ordered/Carnival_run_4

rlu_atari_checkpoints_ordered/Carnival_run_5

rlu_atari_checkpoints_ordered/Centipede_run_1

rlu_atari_checkpoints_ordered/Centipede_run_2

rlu_atari_checkpoints_ordered/Centipede_run_3

rlu_atari_checkpoints_ordered/Centipede_run_4

rlu_atari_checkpoints_ordered/Centipede_run_5

rlu_atari_checkpoints_ordered/ChopperCommand_run_1

rlu_atari_checkpoints_ordered/ChopperCommand_run_2

rlu_atari_checkpoints_ordered/ChopperCommand_run_3

rlu_atari_checkpoints_ordered/ChopperCommand_run_4

rlu_atari_checkpoints_ordered/ChopperCommand_run_5

rlu_atari_checkpoints_ordered/CrazyClimber_run_1

rlu_atari_checkpoints_ordered/CrazyClimber_run_2

rlu_atari_checkpoints_ordered/CrazyClimber_run_3

rlu_atari_checkpoints_ordered/CrazyClimber_run_4

rlu_atari_checkpoints_ordered/CrazyClimber_run_5

rlu_atari_checkpoints_ordered/DemonAttack_run_1

rlu_atari_checkpoints_ordered/DemonAttack_run_2

rlu_atari_checkpoints_ordered/DemonAttack_run_3

rlu_atari_checkpoints_ordered/DemonAttack_run_4

rlu_atari_checkpoints_ordered/DemonAttack_run_5

rlu_atari_checkpoints_ordered/DoubleDunk_run_1

rlu_atari_checkpoints_ordered/DoubleDunk_run_2

rlu_atari_checkpoints_ordered/DoubleDunk_run_3

rlu_atari_checkpoints_ordered/DoubleDunk_run_4

rlu_atari_checkpoints_ordered/DoubleDunk_run_5

rlu_atari_checkpoints_ordered/Enduro_run_1

rlu_atari_checkpoints_ordered/Enduro_run_2

rlu_atari_checkpoints_ordered/Enduro_run_3

rlu_atari_checkpoints_ordered/Enduro_run_4

rlu_atari_checkpoints_ordered/Enduro_run_5

rlu_atari_checkpoints_ordered/FishingDerby_run_1

rlu_atari_checkpoints_ordered/FishingDerby_run_2

rlu_atari_checkpoints_ordered/FishingDerby_run_3

rlu_atari_checkpoints_ordered/FishingDerby_run_4

rlu_atari_checkpoints_ordered/FishingDerby_run_5

rlu_atari_checkpoints_ordered/Freeway_run_1

rlu_atari_checkpoints_ordered/Freeway_run_2

rlu_atari_checkpoints_ordered/Freeway_run_3

rlu_atari_checkpoints_ordered/Freeway_run_4

rlu_atari_checkpoints_ordered/Freeway_run_5

rlu_atari_checkpoints_ordered/Frostbite_run_1

rlu_atari_checkpoints_ordered/Frostbite_run_2

rlu_atari_checkpoints_ordered/Frostbite_run_3

rlu_atari_checkpoints_ordered/Frostbite_run_4

rlu_atari_checkpoints_ordered/Frostbite_run_5

rlu_atari_checkpoints_ordered/Gopher_run_1

rlu_atari_checkpoints_ordered/Gopher_run_2

rlu_atari_checkpoints_ordered/Gopher_run_3

rlu_atari_checkpoints_ordered/Gopher_run_4

rlu_atari_checkpoints_ordered/Gopher_run_5

rlu_atari_checkpoints_ordered/Gravitar_run_1

rlu_atari_checkpoints_ordered/Gravitar_run_2

rlu_atari_checkpoints_ordered/Gravitar_run_3

rlu_atari_checkpoints_ordered/Gravitar_run_4

rlu_atari_checkpoints_ordered/Gravitar_run_5

rlu_atari_checkpoints_ordered/Hero_run_1

rlu_atari_checkpoints_ordered/Hero_run_2

rlu_atari_checkpoints_ordered/Hero_run_3

rlu_atari_checkpoints_ordered/Hero_run_4

rlu_atari_checkpoints_ordered/Hero_run_5

rlu_atari_checkpoints_ordered/IceHockey_run_1

rlu_atari_checkpoints_ordered/IceHockey_run_2

rlu_atari_checkpoints_ordered/IceHockey_run_3

rlu_atari_checkpoints_ordered/IceHockey_run_4

rlu_atari_checkpoints_ordered/IceHockey_run_5

rlu_atari_checkpoints_ordered/Jamesbond_run_1

rlu_atari_checkpoints_ordered/Jamesbond_run_2

rlu_atari_checkpoints_ordered/Jamesbond_run_3

rlu_atari_checkpoints_ordered/Jamesbond_run_4

rlu_atari_checkpoints_ordered/Jamesbond_run_5

rlu_atari_checkpoints_ordered/Kangaroo_run_1

rlu_atari_checkpoints_ordered/Kangaroo_run_2

rlu_atari_checkpoints_ordered/Kangaroo_run_3

rlu_atari_checkpoints_ordered/Kangaroo_run_4

rlu_atari_checkpoints_ordered/Kangaroo_run_5

rlu_atari_checkpoints_ordered/Krull_run_1

rlu_atari_checkpoints_ordered/Krull_run_2

rlu_atari_checkpoints_ordered/Krull_run_3

rlu_atari_checkpoints_ordered/Krull_run_4

rlu_atari_checkpoints_ordered/Krull_run_5

rlu_atari_checkpoints_ordered/KungFuMaster_run_1

rlu_atari_checkpoints_ordered/KungFuMaster_run_2

rlu_atari_checkpoints_ordered/KungFuMaster_run_3

rlu_atari_checkpoints_ordered/KungFuMaster_run_4

rlu_atari_checkpoints_ordered/KungFuMaster_run_5

rlu_atari_checkpoints_ordered/MsPacman_run_1

rlu_atari_checkpoints_ordered/MsPacman_run_2

rlu_atari_checkpoints_ordered/MsPacman_run_3

rlu_atari_checkpoints_ordered/MsPacman_run_4

rlu_atari_checkpoints_ordered/MsPacman_run_5

rlu_atari_checkpoints_ordered/NameThisGame_run_1

rlu_atari_checkpoints_ordered/NameThisGame_run_2

rlu_atari_checkpoints_ordered/NameThisGame_run_3

rlu_atari_checkpoints_ordered/NameThisGame_run_4

rlu_atari_checkpoints_ordered/NameThisGame_run_5

rlu_atari_checkpoints_ordered/Phoenix_run_1

rlu_atari_checkpoints_ordered/Phoenix_run_2

rlu_atari_checkpoints_ordered/Phoenix_run_3

rlu_atari_checkpoints_ordered/Phoenix_run_4

rlu_atari_checkpoints_ordered/Phoenix_run_5

rlu_atari_checkpoints_ordered/Pong_run_1

rlu_atari_checkpoints_ordered/Pong_run_2

rlu_atari_checkpoints_ordered/Pong_run_3

rlu_atari_checkpoints_ordered/Pong_run_4

rlu_atari_checkpoints_ordered/Pong_run_5

rlu_atari_checkpoints_ordered/Pooyan_run_1

rlu_atari_checkpoints_ordered/Pooyan_run_2

rlu_atari_checkpoints_ordered/Pooyan_run_3

rlu_atari_checkpoints_ordered/Pooyan_run_4

rlu_atari_checkpoints_ordered/Pooyan_run_5

rlu_atari_checkpoints_ordered/Qbert_run_1

rlu_atari_checkpoints_ordered/Qbert_run_2

rlu_atari_checkpoints_ordered/Qbert_run_3

rlu_atari_checkpoints_ordered/Qbert_run_4

rlu_atari_checkpoints_ordered/Qbert_run_5

rlu_atari_checkpoints_ordered/Riverraid_run_1

rlu_atari_checkpoints_ordered/Riverraid_run_2

rlu_atari_checkpoints_ordered/Riverraid_run_3

rlu_atari_checkpoints_ordered/Riverraid_run_4

rlu_atari_checkpoints_ordered/Riverraid_run_5

rlu_atari_checkpoints_ordered/RoadRunner_run_1

rlu_atari_checkpoints_ordered/RoadRunner_run_2

rlu_atari_checkpoints_ordered/RoadRunner_run_3

rlu_atari_checkpoints_ordered/RoadRunner_run_4

rlu_atari_checkpoints_ordered/RoadRunner_run_5

rlu_atari_checkpoints_ordered/Robotank_run_1

rlu_atari_checkpoints_ordered/Robotank_run_2

rlu_atari_checkpoints_ordered/Robotank_run_3

rlu_atari_checkpoints_ordered/Robotank_run_4

rlu_atari_checkpoints_ordered/Robotank_run_5

rlu_atari_checkpoints_ordered/Seaquest_run_1

rlu_atari_checkpoints_ordered/Seaquest_run_2

rlu_atari_checkpoints_ordered/Seaquest_run_3

rlu_atari_checkpoints_ordered/Seaquest_run_4

rlu_atari_checkpoints_ordered/Seaquest_run_5

rlu_atari_checkpoints_ordered/SpaceInvaders_run_1

rlu_atari_checkpoints_ordered/SpaceInvaders_run_2

rlu_atari_checkpoints_ordered/SpaceInvaders_run_3

rlu_atari_checkpoints_ordered/SpaceInvaders_run_4

rlu_atari_checkpoints_ordered/SpaceInvaders_run_5

rlu_atari_checkpoints_ordered/StarGunner_run_1

rlu_atari_checkpoints_ordered/StarGunner_run_2

rlu_atari_checkpoints_ordered/StarGunner_run_3

rlu_atari_checkpoints_ordered/StarGunner_run_4

rlu_atari_checkpoints_ordered/StarGunner_run_5

rlu_atari_checkpoints_ordered/TimePilot_run_1

rlu_atari_checkpoints_ordered/TimePilot_run_2

rlu_atari_checkpoints_ordered/TimePilot_run_3

rlu_atari_checkpoints_ordered/TimePilot_run_4

rlu_atari_checkpoints_ordered/TimePilot_run_5

rlu_atari_checkpoints_ordered/UpNDown_run_1

rlu_atari_checkpoints_ordered/UpNDown_run_2

rlu_atari_checkpoints_ordered/UpNDown_run_3

rlu_atari_checkpoints_ordered/UpNDown_run_4

rlu_atari_checkpoints_ordered/UpNDown_run_5

rlu_atari_checkpoints_ordered/VideoPinball_run_1

rlu_atari_checkpoints_ordered/VideoPinball_run_2

rlu_atari_checkpoints_ordered/VideoPinball_run_3

rlu_atari_checkpoints_ordered/VideoPinball_run_4

rlu_atari_checkpoints_ordered/VideoPinball_run_5

rlu_atari_checkpoints_ordered/WizardOfWor_run_1

rlu_atari_checkpoints_ordered/WizardOfWor_run_2

rlu_atari_checkpoints_ordered/WizardOfWor_run_3

rlu_atari_checkpoints_ordered/WizardOfWor_run_4

rlu_atari_checkpoints_ordered/WizardOfWor_run_5

rlu_atari_checkpoints_ordered/YarsRevenge_run_1

rlu_atari_checkpoints_ordered/YarsRevenge_run_2

rlu_atari_checkpoints_ordered/YarsRevenge_run_3

rlu_atari_checkpoints_ordered/YarsRevenge_run_4

rlu_atari_checkpoints_ordered/YarsRevenge_run_5

rlu_atari_checkpoints_ordered/Zaxxon_run_1

rlu_atari_checkpoints_ordered/Zaxxon_run_2

rlu_atari_checkpoints_ordered/Zaxxon_run_3

rlu_atari_checkpoints_ordered/Zaxxon_run_4

rlu_atari_checkpoints_ordered/Zaxxon_run_5