Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

V0.2 rl refinement dist #377

Merged
merged 36 commits into from
Sep 16, 2021
Merged

V0.2 rl refinement dist #377

merged 36 commits into from
Sep 16, 2021

Commits on Jul 27, 2021

  1. Support slice operation in ExperienceSet

    @buptchan
    buptchan committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    2b26d44 View commit details
    Browse the repository at this point in the history

  2. Support naive distributed policy training by proxy

    @buptchan
    buptchan committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    2445f4c View commit details
    Browse the repository at this point in the history

  3. Dynamically allocate trainers according to number of experience

    @buptchan
    buptchan committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    96b983a View commit details
    Browse the repository at this point in the history

  4. code check

    @buptchan
    buptchan committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    3dc1226 View commit details
    Browse the repository at this point in the history

  5. code check

    @buptchan
    buptchan committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    d5601b4 View commit details
    Browse the repository at this point in the history

  6. code check

    @buptchan
    buptchan committed Jul 27, 2021
    Configuration menu
    Copy the full SHA
    8de192f View commit details
    Browse the repository at this point in the history

Commits on Jul 29, 2021

  1. Fix a bug in distributed trianing with no gradient

    @buptchan
    buptchan committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    311c243 View commit details
    Browse the repository at this point in the history

  2. Code check

    @buptchan
    buptchan committed Jul 29, 2021
    Configuration menu
    Copy the full SHA
    1479ffa View commit details
    Browse the repository at this point in the history

Commits on Aug 3, 2021

  1. Move Back-Propagation from trainer to policy_manager and extract trai… 

    …ner-allocation strategy
    @buptchan
    buptchan committed Aug 3, 2021
    Configuration menu
    Copy the full SHA
    e4fc71b View commit details
    Browse the repository at this point in the history

Commits on Aug 4, 2021

  1. 1.call allocate_trainer() at first of update(); 2.refine according to… 

    … code review
    @buptchan
    buptchan committed Aug 4, 2021
    Configuration menu
    Copy the full SHA
    295f551 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2021

  1. Merge from v0.2_rl_refinement

    @buptchan
    buptchan committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    887b90b View commit details
    Browse the repository at this point in the history

  2. Code check

    @buptchan
    buptchan committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    8402253 View commit details
    Browse the repository at this point in the history

  3. Refine code with new interface

    @buptchan
    buptchan committed Aug 5, 2021
    Configuration menu
    Copy the full SHA
    5c294a5 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2021

  1. Update docs of PolicyManger and ExperienceSet

    @buptchan
    buptchan committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    42c2547 View commit details
    Browse the repository at this point in the history

  2. Add images for rl_toolkit docs

    @buptchan
    buptchan committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    ce2e2d2 View commit details
    Browse the repository at this point in the history

  3. Update diagram of PolicyManager

    @buptchan
    buptchan committed Aug 6, 2021
    Configuration menu
    Copy the full SHA
    e27fcb3 View commit details
    Browse the repository at this point in the history

Commits on Aug 9, 2021

  1. merge v0.2_rl_refinement

    @buptchan
    buptchan committed Aug 9, 2021
    Configuration menu
    Copy the full SHA
    4d27cd6 View commit details
    Browse the repository at this point in the history

Commits on Aug 10, 2021

  1. Refine with new interface

    @buptchan
    buptchan committed Aug 10, 2021
    Configuration menu
    Copy the full SHA
    38fecb1 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2021

  1. Extract allocation strategy into allocation_strategy.py

    @buptchan
    buptchan committed Aug 12, 2021
    Configuration menu
    Copy the full SHA
    9b11b65 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2021

  1. Pull from v0.2_rl_refinement

    @buptchan
    buptchan committed Aug 18, 2021
    Configuration menu
    Copy the full SHA
    d5d4f71 View commit details
    Browse the repository at this point in the history

Commits on Aug 19, 2021

  1. Pull rl_refinement

    @buptchan
    buptchan committed Aug 19, 2021
    Configuration menu
    Copy the full SHA
    0a9c588 View commit details
    Browse the repository at this point in the history

Commits on Aug 25, 2021

  1. add distributed_learn() in policies for data-parallel training

    @buptchan
    buptchan committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    437f29d View commit details
    Browse the repository at this point in the history

  2. Pull latest v0.2_rl_refinement branch

    @buptchan
    buptchan committed Aug 25, 2021
    Configuration menu
    Copy the full SHA
    a0fee62 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2021

  1. Update doc of RL_toolkit

    @buptchan
    buptchan committed Aug 26, 2021
    Configuration menu
    Copy the full SHA
    48f40fb View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2021

  1. Add gradient workers for data-parallel

    @buptchan
    buptchan committed Sep 3, 2021
    Configuration menu
    Copy the full SHA
    6f77be1 View commit details
    Browse the repository at this point in the history

Commits on Sep 6, 2021

  1. Refine code and update docs

    @buptchan
    buptchan committed Sep 6, 2021
    Configuration menu
    Copy the full SHA
    327aa83 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2021

  1. Merge from v0.2_rl_refinement, refactoring based on numpy batch d… 

    …ata.
    @buptchan
    buptchan committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    5deb4dc View commit details
    Browse the repository at this point in the history

  2. Lint check

    @buptchan
    buptchan committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    ab5a631 View commit details
    Browse the repository at this point in the history

  3. Fix bugs in multiprocessing mode with data-parallel

    @buptchan
    buptchan committed Sep 8, 2021
    Configuration menu
    Copy the full SHA
    74b17c0 View commit details
    Browse the repository at this point in the history

Commits on Sep 9, 2021

  1. Refine by comments

    @buptchan
    buptchan committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    f938318 View commit details
    Browse the repository at this point in the history

  2. Rename trainer to worker

    @buptchan
    buptchan committed Sep 9, 2021
    Configuration menu
    Copy the full SHA
    267bf6c View commit details
    Browse the repository at this point in the history

Commits on Sep 13, 2021

  1. Rename distributed_learn to learn_with_data_parallel

    @buptchan
    buptchan committed Sep 13, 2021
    Configuration menu
    Copy the full SHA
    807ec7c View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2021

  1. Refine allocator and remove redundant code in policy_manager

    @buptchan
    buptchan committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    b67953d View commit details
    Browse the repository at this point in the history

  2. Pull latest v0.2_rl_refinement

    @buptchan
    buptchan committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    d6f9a6b View commit details
    Browse the repository at this point in the history

  3. import agent2policies in base branch

    @buptchan
    buptchan committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    aed932f View commit details
    Browse the repository at this point in the history

  4. remove arugments in allocate_by_policy and so on

    @buptchan
    buptchan committed Sep 15, 2021
    Configuration menu
    Copy the full SHA
    4eaebfb View commit details
    Browse the repository at this point in the history