Deep Reinforcement Learning Nanodegree Projects

This repository contains material related to Udacity's Deep Reinforcement Learning Nanodegree program.

Table of Contents

Projects

The labs and projects can be found below. All of the projects use rich simulation environments from Unity ML-Agents. In the Deep Reinforcement Learning Nanodegree program, you will receive a review of your project. These reviews are meant to give you personalized feedback and to tell you what can be improved in your code.

• Navigation: In the first project, you will train an agent to collect yellow bananas while avoiding blue bananas.
• Continuous Control: In the second project, you will train an robotic arm to reach target locations.
• Collaboration and Competition: In the third project, you will train a pair of agents to play tennis!

Resources

• Cheatsheet

Dependencies

To set up your python environment to run the code in this repository, follow the instructions below.

1. Create (and activate) a new environment with Python 3.6.

   • Linux or Mac:

   conda create --name drlnd python=3.6
   source activate drlnd

   • Windows:

   conda create --name drlnd python=3.6 
   activate drlnd

2. Follow the instructions in this repository to perform a minimal install of OpenAI gym.

   • Next, install the classic control environment group by following the instructions here.
   • Then, install the box2d environment group by following the instructions here.

3. Install PyTorch

conda install pytorch=0.4.0 -c pytorch

4. Clone the repository (if you haven't already!), and navigate to the python/ folder. Then, install several dependencies.

git clone https://github.com/udacity/deep-reinforcement-learning.git
cd deep-reinforcement-learning/python
pip install .

5. Create an IPython kernel for the drlnd environment.

python -m ipykernel install --user --name drlnd --display-name "drlnd"

6. Before running code in a notebook, change the kernel to match the drlnd environment by using the drop-down Kernel menu.