Spinning Up with Docker and VS Code

Use this repo to run Open AI's Spinning Up package in a Docker container with full visualisations using VS Code.

Setup

git clone https://www.github.com/cj-l/spinningup-docker
cd spinningup-docker
code .

Click "Reopen in container" in VS Code's Remote-Containers menu.

• will install spinningup and other dependencies

Run the following commands to enable watching videos of trained agents

export PYTHONPATH="${PYTHONPATH}:`pwd`"
Xvfb :1 -screen 0 1024x768x24 -ac +extension GLX +render -noreset &> xvfb.log &
export DISPLAY=:1

Test the installation

Train PPO

python -m spinup.run ppo --hid "[32,32]" --env LunarLander-v2 --exp_name installtest --gamma 0.999

Watch a video

python -m spinup.run test_policy data/installtest/installtest_s0