Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

refactor(gry): refactor reward model #636

Open
wants to merge 63 commits into
base: main
Choose a base branch
from
Open

refactor(gry): refactor reward model #636

wants to merge 63 commits into from

Commits on Apr 5, 2023

  1. refactor network and red reward model

    @ruoyuGao
    ruoyuGao committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    c372c07 View commit details
    Browse the repository at this point in the history

  2. create reward model utils

    @ruoyuGao
    ruoyuGao committed Apr 5, 2023
    Configuration menu
    Copy the full SHA
    6718e4a View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2023

  1. polish network and reward model utils, provide test for them

    @ruoyuGao
    ruoyuGao committed Apr 6, 2023
    Configuration menu
    Copy the full SHA
    be7039a View commit details
    Browse the repository at this point in the history

Commits on Apr 10, 2023

  1. refactor network for two method: learn and forward

    @ruoyuGao
    ruoyuGao committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    a4de466 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into ruoyugao

    @ruoyuGao
    ruoyuGao committed Apr 10, 2023
    Configuration menu
    Copy the full SHA
    d615c14 View commit details
    Browse the repository at this point in the history

Commits on Apr 11, 2023

  1. refactor rnd

    @ruoyuGao
    ruoyuGao committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    7a8ec6e View commit details
    Browse the repository at this point in the history

  2. refactor gail

    @ruoyuGao
    ruoyuGao committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    55c7be8 View commit details
    Browse the repository at this point in the history

  3. fix gail for unit test

    @ruoyuGao
    ruoyuGao committed Apr 11, 2023
    Configuration menu
    Copy the full SHA
    ff60716 View commit details
    Browse the repository at this point in the history

Commits on Apr 12, 2023

  1. refactor icm

    @ruoyuGao
    ruoyuGao committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    6b80392 View commit details
    Browse the repository at this point in the history

  2. fix wrong unit test in test_reward_model_utils

    @ruoyuGao
    ruoyuGao committed Apr 12, 2023
    Configuration menu
    Copy the full SHA
    25d49b5 View commit details
    Browse the repository at this point in the history

Commits on Apr 13, 2023

  1. refactor gcl and pwil

    @ruoyuGao
    ruoyuGao committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    c081ff0 View commit details
    Browse the repository at this point in the history

  2. refactor pdeil

    @ruoyuGao
    ruoyuGao committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    f1218cd View commit details
    Browse the repository at this point in the history

  3. add hidden_size_list to gail

    @ruoyuGao
    ruoyuGao committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    d9060c2 View commit details
    Browse the repository at this point in the history

  4. change gail test for new config

    @ruoyuGao
    ruoyuGao committed Apr 13, 2023
    Configuration menu
    Copy the full SHA
    179182a View commit details
    Browse the repository at this point in the history

Commits on Apr 14, 2023

  1. refactor trex network

    @ruoyuGao
    ruoyuGao committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    d067731 View commit details
    Browse the repository at this point in the history

  2. fix style and wrong import

    @ruoyuGao
    ruoyuGao committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    29f0d55 View commit details
    Browse the repository at this point in the history

  3. fix style for trex

    @ruoyuGao
    ruoyuGao committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    4ec0bd3 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into ruoyugao

    @ruoyuGao
    ruoyuGao committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    800f090 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'ruoyugao' of https://github.com/ruoyuGao/DI-engine into… 

    … ruoyugao
    @ruoyuGao
    ruoyuGao committed Apr 14, 2023
    Configuration menu
    Copy the full SHA
    c64b5c7 View commit details
    Browse the repository at this point in the history

Commits on Apr 17, 2023

  1. fix unit test for trex onppo

    @ruoyuGao
    ruoyuGao committed Apr 17, 2023
    Configuration menu
    Copy the full SHA
    660af32 View commit details
    Browse the repository at this point in the history

Commits on Apr 21, 2023

  1. Merge branch 'main' into ruoyugao

    @ruoyuGao
    ruoyuGao committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    1b0d579 View commit details
    Browse the repository at this point in the history

  2. refactor ngu and provide cartpole config file

    @ruoyuGao
    ruoyuGao committed Apr 21, 2023
    Configuration menu
    Copy the full SHA
    b4e81dd View commit details
    Browse the repository at this point in the history

Commits on Apr 26, 2023

  1. change reward entry

    @ruoyuGao
    ruoyuGao committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    eddc80d View commit details
    Browse the repository at this point in the history

  2. change trex entry to new entry, combine old trex test to new test

    @ruoyuGao
    ruoyuGao committed Apr 26, 2023
    Configuration menu
    Copy the full SHA
    6e2b867 View commit details
    Browse the repository at this point in the history

Commits on Apr 28, 2023

  1. Merge branch 'main' into ruoyugao

    @ruoyuGao
    ruoyuGao committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    e25d265 View commit details
    Browse the repository at this point in the history

  2. refactor trex config file

    @ruoyuGao
    ruoyuGao committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    97634dc View commit details
    Browse the repository at this point in the history

  3. refactor trex config file

    @ruoyuGao
    ruoyuGao committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    f099cac View commit details
    Browse the repository at this point in the history

  4. refactor trex config file

    @ruoyuGao
    ruoyuGao committed Apr 28, 2023
    Configuration menu
    Copy the full SHA
    0c48c08 View commit details
    Browse the repository at this point in the history

Commits on May 3, 2023

  1. add gail to new reward entry

    @ruoyuGao
    ruoyuGao committed May 3, 2023
    Configuration menu
    Copy the full SHA
    594d619 View commit details
    Browse the repository at this point in the history

  2. remove preferenced based irl entry(used for trex, drex before)

    @ruoyuGao
    ruoyuGao committed May 3, 2023
    Configuration menu
    Copy the full SHA
    58a2bff View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into ruoyugao

    @ruoyuGao
    ruoyuGao committed May 3, 2023
    Configuration menu
    Copy the full SHA
    e9db652 View commit details
    Browse the repository at this point in the history

  4. remove unuse code in gcl

    @ruoyuGao
    ruoyuGao committed May 3, 2023
    Configuration menu
    Copy the full SHA
    822d7a4 View commit details
    Browse the repository at this point in the history

Commits on May 4, 2023

  1. change clear data from pipeline to RM && add ngu to new entry

    @ruoyuGao
    ruoyuGao committed May 4, 2023
    Configuration menu
    Copy the full SHA
    be03aa9 View commit details
    Browse the repository at this point in the history

  2. remove ngu old entry

    @ruoyuGao
    ruoyuGao committed May 4, 2023
    Configuration menu
    Copy the full SHA
    d3ce3e2 View commit details
    Browse the repository at this point in the history

  3. fix env pool test bug

    @ruoyuGao
    ruoyuGao committed May 4, 2023
    Configuration menu
    Copy the full SHA
    4c19aa3 View commit details
    Browse the repository at this point in the history

  4. add drex to new entry

    @ruoyuGao
    ruoyuGao committed May 4, 2023
    Configuration menu
    Copy the full SHA
    0cc2149 View commit details
    Browse the repository at this point in the history

  5. fix unit test for trex and gail

    @ruoyuGao
    ruoyuGao committed May 4, 2023
    Configuration menu
    Copy the full SHA
    5b4e4cc View commit details
    Browse the repository at this point in the history

  6. fix style

    @ruoyuGao
    ruoyuGao committed May 4, 2023
    Configuration menu
    Copy the full SHA
    ff4de47 View commit details
    Browse the repository at this point in the history

Commits on May 5, 2023

  1. fix style for drex unittest

    @ruoyuGao
    ruoyuGao committed May 5, 2023
    Configuration menu
    Copy the full SHA
    9e63ef1 View commit details
    Browse the repository at this point in the history

  2. fix drex unittest

    @ruoyuGao
    ruoyuGao committed May 5, 2023
    Configuration menu
    Copy the full SHA
    ca2e2db View commit details
    Browse the repository at this point in the history

  3. fix bug in minigrid env

    @ruoyuGao
    ruoyuGao committed May 5, 2023
    Configuration menu
    Copy the full SHA
    8716afe View commit details
    Browse the repository at this point in the history

Commits on May 6, 2023

  1. add explain for rm utils

    @ruoyuGao
    ruoyuGao committed May 6, 2023
    Configuration menu
    Copy the full SHA
    9036141 View commit details
    Browse the repository at this point in the history

  2. move RM unittest into one file

    @ruoyuGao
    ruoyuGao committed May 6, 2023
    Configuration menu
    Copy the full SHA
    6b9754a View commit details
    Browse the repository at this point in the history

  3. Merge branch 'main' into ruoyugao

    @ruoyuGao
    ruoyuGao committed May 6, 2023
    Configuration menu
    Copy the full SHA
    a52a1c0 View commit details
    Browse the repository at this point in the history

Commits on May 8, 2023

  1. add drex config

    @ruoyuGao
    ruoyuGao committed May 8, 2023
    Configuration menu
    Copy the full SHA
    a5c7989 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'ruoyugao' of https://github.com/ruoyuGao/DI-engine into… 

    … ruoyugao
    @ruoyuGao
    ruoyuGao committed May 8, 2023
    Configuration menu
    Copy the full SHA
    d631237 View commit details
    Browse the repository at this point in the history

Commits on May 9, 2023

  1. fix ngu wrapper bug in minigrid

    @ruoyuGao
    ruoyuGao committed May 9, 2023
    Configuration menu
    Copy the full SHA
    f42d131 View commit details
    Browse the repository at this point in the history

  2. fix ngu wrapper bug in minigrid

    @ruoyuGao
    ruoyuGao committed May 9, 2023
    Configuration menu
    Copy the full SHA
    edff260 View commit details
    Browse the repository at this point in the history

Commits on May 10, 2023

  1. Merge branch 'main' into ruoyugao

    @ruoyuGao
    ruoyuGao committed May 10, 2023
    Configuration menu
    Copy the full SHA
    6ab66e1 View commit details
    Browse the repository at this point in the history

Commits on May 22, 2023

  1. refactor gcl, add it to reward entry

    @ruoyuGao
    ruoyuGao committed May 22, 2023
    Configuration menu
    Copy the full SHA
    cb0c627 View commit details
    Browse the repository at this point in the history

  2. refactor gcl config and bash format other config

    @ruoyuGao
    ruoyuGao committed May 22, 2023
    Configuration menu
    Copy the full SHA
    016fbb3 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'ruoyugao' of https://github.com/ruoyuGao/DI-engine into… 

    … ruoyugao
    @ruoyuGao
    ruoyuGao committed May 22, 2023
    Configuration menu
    Copy the full SHA
    cf50148 View commit details
    Browse the repository at this point in the history

  4. fix bug for test, remove wrong comment

    @ruoyuGao
    ruoyuGao committed May 22, 2023
    Configuration menu
    Copy the full SHA
    919c01b View commit details
    Browse the repository at this point in the history

Commits on Jun 6, 2023

  1. polish code for ngu, drex, base rm and entry

    @ruoyuGao
    ruoyuGao committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    a1d0b3a View commit details
    Browse the repository at this point in the history

  2. Merge branch 'main' into ruoyugao

    @ruoyuGao
    ruoyuGao committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    0a0af3c View commit details
    Browse the repository at this point in the history

  3. polish code for all rm

    @ruoyuGao
    ruoyuGao committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    e310b4c View commit details
    Browse the repository at this point in the history

  4. fix style for ngu

    @ruoyuGao
    ruoyuGao committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    92dc227 View commit details
    Browse the repository at this point in the history

  5. polish comment for config files

    @ruoyuGao
    ruoyuGao committed Jun 6, 2023
    Configuration menu
    Copy the full SHA
    a4f364d View commit details
    Browse the repository at this point in the history

Commits on Jun 9, 2023

  1. add gcl unit test

    @ruoyuGao
    ruoyuGao committed Jun 9, 2023
    Configuration menu
    Copy the full SHA
    1f06dec View commit details
    Browse the repository at this point in the history

Commits on Jun 19, 2023

  1. polish RM

    @ruoyuGao
    ruoyuGao committed Jun 19, 2023
    Configuration menu
    Copy the full SHA
    a547b3b View commit details
    Browse the repository at this point in the history

Commits on Jun 20, 2023

  1. fix style for rnd and icm

    @ruoyuGao
    ruoyuGao committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    97da5c6 View commit details
    Browse the repository at this point in the history

  2. fix style for rnd and icm

    @ruoyuGao
    ruoyuGao committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    774b2a4 View commit details
    Browse the repository at this point in the history

  3. fix style for icm

    @ruoyuGao
    ruoyuGao committed Jun 20, 2023
    Configuration menu
    Copy the full SHA
    b78e36c View commit details
    Browse the repository at this point in the history