Just another DAgger algorithm implementation
Branch: master
Clone or download
bustermachinej
bustermachinej Updated README.md
Latest commit 17da809 Apr 10, 2017
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
experts Add files via upload Apr 10, 2017
LICENSE
README.md Updated README.md Apr 10, 2017
dagger_humanoid.png Add files via upload Apr 10, 2017
humanoid.gif Add files via upload Apr 10, 2017
load_policy.py Add files via upload Apr 10, 2017
run_dagger.py Update run_dagger.py Apr 10, 2017
tf_util.py Add files via upload Apr 10, 2017

README.md

Just Another DAgger Implementation

DAgger is a reinforcement learning (imitation learning, to be exact) algorithm that uses data aggregation techniques to address the states distribution mismatch problem. The detailed algorithm is described in the paper.

This is my implementation of the DAgger. The code is based on the starter code and policy function generously provided by the Berkeley CS294 course.

In the Humanoid experiment, the goal is to train the humanoid to walk fast forward without falling. Below is the humanoid trained using DAgger.

The following figure plots the mean reward by DAgger over the iterations in the humanoid experiment. DAgger is able to achieve expert-level performance after a few data aggregation iterations.

How to run the code

Run the following command: python run_dagger.py

Dependencies

(More coming soon...)

Author

J.J. Zhu