Skip to content
CS 294-131 Project, reimplementing
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.
baselines @ 90841aa
cleverhans @ 97488e2

Adversarial Attacks on Deep Reinforcement Learning


  1. Run git clone --recurse-submodules to clone with submodules and cd adversarial_rl.
  2. Run pip install -e . to install the main dependencies.
  3. Run mv baselines ../baselines, cd ../baselines, then pip install -e . --user to install our baselines fork.

Running Experiments

  • To train models, run bash scripts/
    • To parallelize training runs, modify the training script to echo commands instead of executing them and run bash ../scripts/ | xargs -PN -ICMD /bin/bash -exc CMD, replacing N with the number of cores available.
  • To attack trained models, run bash scripts/
    • Use the same trick as above to parallelize.


PPO, TRPO, A2C and DQN models trained on CartPole and Acrobot are in the models/ folder. Results of attacks are available in accompanying writeup.


You can’t perform that action at this time.