Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Recurrent DQN families with a new interface #436

Merged
merged 57 commits into from Aug 9, 2019
Merged

Recurrent DQN families with a new interface #436

merged 57 commits into from Aug 9, 2019

Commits on Apr 6, 2019

  1. Merge branch 'recurrent-ppo-squash' into recurrent-dqn

    @muupan
    muupan committed Apr 6, 2019
    Configuration menu
    Copy the full SHA
    a65be21 View commit details
    Browse the repository at this point in the history

Commits on Apr 7, 2019

  1. Use new recurrent model in DQN

    @muupan
    muupan committed Apr 7, 2019
    Configuration menu
    Copy the full SHA
    03f1e06 View commit details
    Browse the repository at this point in the history

  2. Fix double dqn

    @muupan
    muupan committed Apr 7, 2019
    Configuration menu
    Copy the full SHA
    19b8051 View commit details
    Browse the repository at this point in the history

  3. Add DRQN example

    @muupan
    muupan committed Apr 7, 2019
    Configuration menu
    Copy the full SHA
    91bc211 View commit details
    Browse the repository at this point in the history

  4. Fix dtype error

    @muupan
    muupan committed Apr 7, 2019
    Configuration menu
    Copy the full SHA
    a85f32a View commit details
    Browse the repository at this point in the history

  5. Use mean of loss to avoid effect from sequence length

    @muupan
    muupan committed Apr 7, 2019
    Configuration menu
    Copy the full SHA
    24459d8 View commit details
    Browse the repository at this point in the history

Commits on Apr 8, 2019

  1. Stabilize tests

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    1bdfaa6 View commit details
    Browse the repository at this point in the history

  2. Renew recurrent AL

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    b0a4063 View commit details
    Browse the repository at this point in the history

  3. Renew recurrent PAL

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    ac6bd4d View commit details
    Browse the repository at this point in the history

  4. Renew recurrent DoublePAL

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    f57e1d9 View commit details
    Browse the repository at this point in the history

  5. Add recurrent DPP

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    78e0059 View commit details
    Browse the repository at this point in the history

  6. Make SARSA off-policy, batched, and recurrent

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    15740ff View commit details
    Browse the repository at this point in the history

  7. Renew recurrent CategoricalDQN

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    9783ab7 View commit details
    Browse the repository at this point in the history

  8. Make IQN recurrent

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    8ed0587 View commit details
    Browse the repository at this point in the history

  9. Fix to support py2

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    e9efeaf View commit details
    Browse the repository at this point in the history

  10. Renew recurrent ResidualDQN

    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    9f41f5c View commit details
    Browse the repository at this point in the history

  11. Remove --episodic-replay options 

    since it does not make much sense to use this without recurrent models.
supporting recurrent models in these examples can be future work.
    @muupan
    muupan committed Apr 8, 2019
    Configuration menu
    Copy the full SHA
    c1a1581 View commit details
    Browse the repository at this point in the history

Commits on May 6, 2019

  1. Update examples/ale/train_drqn_ale.py 

    Co-Authored-By: muupan <muupan@gmail.com>
    @prabhatnagarajan @muupan
    prabhatnagarajan and muupan committed May 6, 2019
    Configuration menu
    Copy the full SHA
    b6fdf53 View commit details
    Browse the repository at this point in the history

  2. Update examples/ale/train_drqn_ale.py 

    Co-Authored-By: muupan <muupan@gmail.com>
    @prabhatnagarajan @muupan
    prabhatnagarajan and muupan committed May 6, 2019
    Configuration menu
    Copy the full SHA
    90f0b5a View commit details
    Browse the repository at this point in the history

  3. Update examples/ale/train_ppo_ale.py 

    Co-Authored-By: muupan <muupan@gmail.com>
    @prabhatnagarajan @muupan
    prabhatnagarajan and muupan committed May 6, 2019
    Configuration menu
    Copy the full SHA
    9febe00 View commit details
    Browse the repository at this point in the history

  4. Add options

    @muupan
    muupan committed May 6, 2019
    Configuration menu
    Copy the full SHA
    c7a519d View commit details
    Browse the repository at this point in the history

  5. Merge branch 'recurrent-ppo-squash' into recurrent-dqn

    @muupan
    muupan committed May 6, 2019
    Configuration menu
    Copy the full SHA
    162330a View commit details
    Browse the repository at this point in the history

  6. Merge branch 'master' into recurrent-dqn

    @muupan
    muupan committed May 6, 2019
    Configuration menu
    Copy the full SHA
    496ffc6 View commit details
    Browse the repository at this point in the history

  7. Use the new recurrent interface for CategoricalDoubleDQN

    @muupan
    muupan committed May 6, 2019
    Configuration menu
    Copy the full SHA
    bb40059 View commit details
    Browse the repository at this point in the history

  8. Mark IQN as supporting recurrent

    @muupan
    muupan committed May 6, 2019
    Configuration menu
    Copy the full SHA
    6dc49e9 View commit details
    Browse the repository at this point in the history

Commits on May 11, 2019

  1. Merge branch 'master' into recurrent-dqn

    @muupan
    muupan committed May 11, 2019
    Configuration menu
    Copy the full SHA
    730ee88 View commit details
    Browse the repository at this point in the history

Commits on Jun 25, 2019

  1. Merge branch 'master' into recurrent-dqn

    @muupan
    muupan committed Jun 25, 2019
    Configuration menu
    Copy the full SHA
    61c8d06 View commit details
    Browse the repository at this point in the history

  2. Add --final-eval-n-episodes for faster testing

    @muupan
    muupan committed Jun 25, 2019
    Configuration menu
    Copy the full SHA
    c631ed7 View commit details
    Browse the repository at this point in the history

  3. Add test for examples/ale/train_drqn_ale.py

    @muupan
    muupan committed Jun 25, 2019
    Configuration menu
    Copy the full SHA
    cdf3d2c View commit details
    Browse the repository at this point in the history

Commits on Jul 1, 2019

  1. Move to examples/atari

    @muupan
    muupan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    2194d7d View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into recurrent-dqn

    @muupan
    muupan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    d974719 View commit details
    Browse the repository at this point in the history

  3. Rename the option 

    since it is only used for demo
    @muupan
    muupan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    7e1ef1a View commit details
    Browse the repository at this point in the history

  4. Add test for train_drqn_ale.py

    @muupan
    muupan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    ba5bfc3 View commit details
    Browse the repository at this point in the history

  5. Add DRQN to examples/atari/README.md

    @muupan
    muupan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    573d29b View commit details
    Browse the repository at this point in the history

  6. Remove examples_tests/ale/test_drqn.sh

    @muupan
    muupan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    cf848d6 View commit details
    Browse the repository at this point in the history

  7. Update chainerrl/agents/dqn.py 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    6ce8fb6 View commit details
    Browse the repository at this point in the history

  8. Update examples_tests/atari/test_drqn.sh 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    55241fd View commit details
    Browse the repository at this point in the history

  9. Update examples_tests/atari/test_drqn.sh 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    52105cd View commit details
    Browse the repository at this point in the history

  10. Update examples_tests/atari/test_drqn.sh 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Jul 1, 2019
    Configuration menu
    Copy the full SHA
    8499465 View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2019

  1. Merge branch 'master' into recurrent-dqn

    @muupan
    muupan committed Jul 17, 2019
    Configuration menu
    Copy the full SHA
    8f89ee4 View commit details
    Browse the repository at this point in the history

Commits on Jul 18, 2019

  1. Update chainerrl/replay_buffer.py 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Jul 18, 2019
    Configuration menu
    Copy the full SHA
    eccee63 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'master' into recurrent-dqn

    @muupan
    muupan committed Jul 18, 2019
    Configuration menu
    Copy the full SHA
    0722695 View commit details
    Browse the repository at this point in the history

  3. Add DRQN to README

    @muupan
    muupan committed Jul 18, 2019
    Configuration menu
    Copy the full SHA
    ea692c7 View commit details
    Browse the repository at this point in the history

  4. Add assert message

    @muupan
    muupan committed Jul 18, 2019
    Configuration menu
    Copy the full SHA
    df482b2 View commit details
    Browse the repository at this point in the history

Commits on Jul 31, 2019

  1. Update chainerrl/agents/sarsa.py 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Jul 31, 2019
    Configuration menu
    Copy the full SHA
    aea32d7 View commit details
    Browse the repository at this point in the history

  2. Update chainerrl/agents/sarsa.py 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Jul 31, 2019
    Configuration menu
    Copy the full SHA
    4100079 View commit details
    Browse the repository at this point in the history

  3. Restore chainer.using_config('train', False)

    @muupan
    muupan committed Jul 31, 2019
    Configuration menu
    Copy the full SHA
    c5df80a View commit details
    Browse the repository at this point in the history

  4. Reduce redundancy

    @muupan
    muupan committed Jul 31, 2019
    Configuration menu
    Copy the full SHA
    2c68749 View commit details
    Browse the repository at this point in the history

  5. Use a full path

    @muupan
    muupan committed Jul 31, 2019
    Configuration menu
    Copy the full SHA
    f0a67bd View commit details
    Browse the repository at this point in the history

  6. Merge two methods into one

    @muupan
    muupan committed Jul 31, 2019
    Configuration menu
    Copy the full SHA
    65b25cd View commit details
    Browse the repository at this point in the history

  7. Merge branch 'master' into recurrent-dqn

    @muupan
    muupan committed Jul 31, 2019
    Configuration menu
    Copy the full SHA
    2360686 View commit details
    Browse the repository at this point in the history

  8. Fix syntax error with python2

    @muupan
    muupan committed Jul 31, 2019
    Configuration menu
    Copy the full SHA
    78b5e3c View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2019

  1. Update examples_tests/atari/test_drqn.sh 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Aug 9, 2019
    Configuration menu
    Copy the full SHA
    4e5d0b9 View commit details
    Browse the repository at this point in the history

  2. Remove commented out code

    @muupan
    muupan committed Aug 9, 2019
    Configuration menu
    Copy the full SHA
    fdca04d View commit details
    Browse the repository at this point in the history

  3. Update examples_tests/atari/test_drqn.sh 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Aug 9, 2019
    Configuration menu
    Copy the full SHA
    22d13df View commit details
    Browse the repository at this point in the history

  4. Update examples/atari/train_drqn_ale.py 

    Co-Authored-By: Prabhat Nagarajan <prabhat.nagarajan@gmail.com>
    @muupan @prabhatnagarajan
    muupan and prabhatnagarajan committed Aug 9, 2019
    Configuration menu
    Copy the full SHA
    467f845 View commit details
    Browse the repository at this point in the history

  5. Add a link to DRQN paper

    @muupan
    muupan committed Aug 9, 2019
    Configuration menu
    Copy the full SHA
    9070c76 View commit details
    Browse the repository at this point in the history