by Weiye Zhao, Anthony Liang, Changliu Liu
The repo contains the implementation for reinforcement learning motion planner to ensure safe driving dehavior on extreme road conditions
The rollout simulator is build on top of pygame. Currenly simple unicycle dynamics model is deployed in simulation. Sensors of autonomous vehicle include ranges sensors, distance to center line, and etc. High-fidelity approximation of real world simulation will be added for future implentation.
Clone repo:
git clone --recursive https://github.com/intelligent-control-lab/Reinforcement-Learning-Motion-Planning-for-Autonomous-Driving.git
git submodule update --init --recursive
cd spinningup/
and pip3 install -e .
-
Create virtualenv for development
./setup [virtualenv name] [cpu/gpu]
-
Install the gym environment:
pip install -e ICLcar_env
-
Running the simulator in manual mode:
python3 ICLcar_env/gym_ICLcar/test_car_gym.py -es exp_settings/default_settings.yaml exp_settings/human_settings.yaml
-
Train SAC agent with SpinningUp implementation.
-
python3 -m ipdb -c continue src/external/spinup_main.py -es exp_settings/default_settings.yaml exp_settings/exp_settings.yaml
-
python3 -m ipdb -c continue src/external/spinup_main.py -es exp_settings/default_settings.yaml exp_settings/exp_settings.yaml -eg exp_settings/exp_grid.yaml
-
-
Evaluate on trained checkpoint.
python3 -m ipdb -c continue src/external/spinup_main.py -es exp_settings/default_settings.yaml exp_settings/test_settings.yaml
-
View logs on tensorboard (make sure you first ssh with port forwarding)
tensorboard --logdir={log_dir} --port {server_port} --host localhost
- if ModuleNotFoundError during execution, try
export PYTHONPATH=$PYTHONPATH:.
Installing rllab
git clone https://github.com/rll/rllab.git
./scripts/setup_osx.sh
source activate rllab3
conda create -n rllab3 python=3.5
# might need to create your own requirements.txt if you run into installation errors
Install spinningup
git clone https://github.com/openai/spinningup.git
cd spinningup
pip install -e .