Stochastic Neural Networks for Hierarchical Reinforcement Learning
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
algos cleanoing Mar 28, 2017
bonus_evaluators cleanoing Mar 28, 2017
core initial commit Mar 24, 2017
distributions initial commit Mar 24, 2017
envs swimmer env Mar 24, 2017
policies fix imports Apr 17, 2018
regressors fix imports Apr 17, 2018
runs fix imports Apr 17, 2018
sampler initial commit Mar 24, 2017
warm_start fix imports Apr 17, 2018
.gitignore initial commit Mar 24, 2017
LICENSE Initial commit Mar 24, 2017
README.md Update README.md Apr 8, 2017
__init__.py initial commit Mar 24, 2017

README.md

How to run snn4hrl

Stochastic Neural Networks for Hierarchical Reinforcement Learning (snn4hrl) as presented at ICLR by Carlos Florensa, Yan Duan, Pieter Abbeel (https://openreview.net/forum?id=B1oK8aoxe&noteId=B1oK8aoxe)

Checkout the videos!

To reproduce the results, you should first have rllab and Mujoco v1.31 configured. Then, run the following commands in the root folder of rllab:

git submodule add -f https://github.com/florensacc/snn4hrl.git sandbox/snn4hrl
touch sandbox/__init__.py

Then you can do the following:

  • Train a SNN for the Swimmer environment via python sandbox/snn4hrl/runs/train_snn.py
  • Look at the visitation plot including the visitations of every latent code in data/local/egoSwimmer-snn/
  • Train a hierarchical policy on top of that SNN via python sandbox/snn4hrl/runs/hier-snn-egoSwimmer-gather.py