Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add notebook links + remove old notebook #9

Merged
merged 2 commits into from May 10, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
38 changes: 35 additions & 3 deletions README.md
Expand Up @@ -4,6 +4,38 @@

Website: https://araffin.github.io/tools-for-robotic-rl-icra2022/

Tools:
- https://github.com/eager-dev/eagerx
- https://github.com/DLR-RM/stable-baselines3
## Tools

- EAGERX: https://github.com/eager-dev/eagerx
- Stable-Baselines3 (SB3): https://github.com/DLR-RM/stable-baselines3
- Gym: https://github.com/openai/gym
- Optuna: https://github.com/optuna/optuna/

## Notebooks

Click on each link to open the notebook in Google Colab.

### Gym / Stable-Baselines3 (SB3) / Optuna

Stable-Baselines3 notebooks can be found in the `notebooks/` folder.

- [Gym/Stable Baselines3 Getting Started](https://colab.research.google.com/github/araffin/tools-for-robotic-rl-icra2022/blob/main/notebooks/icra_hands_on_sb3.ipynb)
- [Hyperparameter tuning with Optuna](https://colab.research.google.com/github/araffin/tools-for-robotic-rl-icra2022/blob/main/notebooks/optuna_lab.ipynb)


### EAGERx

EAGERX notebooks can be found in the [eagerx tutorials](https://github.com/eager-dev/eagerx_tutorials) repository.

- [Tutorial 1: Environment Creation and Training with EAGERx](https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/1_environment_creation.ipynb)
- [Tutorial 2: Reset and Step Function](https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/2_reset_and_step.ipynb)
- [Tutorial 3: Converters](https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/3_converters.ipynb)
- [Tutorial 4: Nodes and Graph Validity](https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/4_nodes.ipynb)
- [Tutorial 5: Adding Engine Support for an Object](https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/5_engine_implementation.ipynb)
- [Tutorial 6: More Informative Rendering](https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/6_rendering.ipynb)
- [Tutorial 7: Reset Routines](https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/7_reset_routine.ipynb)


## Slides

TBA
42 changes: 42 additions & 0 deletions index.html
Expand Up @@ -34,6 +34,9 @@
<a class="navbar-item" href="#schedule">
Schedule
</a>
<a class="navbar-item" href="#notebooks">
Notebooks
</a>
<a class="navbar-item" href="#speakers">
Speakers
</a>
Expand Down Expand Up @@ -228,6 +231,45 @@ <h3 class="subtitle has-text-centered">

</section>

<section class="section">
<h2 class="title has-text-centered" id="notebooks">Notebooks</h2>

<h3 class="title has-text-centered">Stable-Baselines3 (SB3)</h3>
<ol>
<li><a
href="https://colab.research.google.com/github/araffin/tools-for-robotic-rl-icra2022/blob/main/notebooks/icra_hands_on_sb3.ipynb">Gym/Stable
Baselines3 Getting Started</a></li>
<li><a
href="https://colab.research.google.com/github/araffin/tools-for-robotic-rl-icra2022/blob/main/notebooks/optuna_lab.ipynb">Hyperparameter
tuning with Optuna</a></li>
</ol>

<h3 class="title has-text-centered">EAGERx</h3>
<ol>
<li><a
href="https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/1_environment_creation.ipynb">Tutorial
1: Environment Creation and Training with EAGERx</a></li>
<li><a
href="https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/2_reset_and_step.ipynb">Tutorial
2: Reset and Step Function</a></li>
<li><a
href="https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/3_converters.ipynb">Tutorial
3: Converters</a></li>
<li><a
href="https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/4_nodes.ipynb">Tutorial
4: Nodes and Graph Validity</a></li>
<li><a
href="https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/5_engine_implementation.ipynb">Tutorial
5: Adding Engine Support for an Object</a></li>
<li><a
href="https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/6_rendering.ipynb">Tutorial
6: More Informative Rendering</a></li>
<li><a
href="https://colab.research.google.com/github/eager-dev/eagerx_tutorials/blob/master/tutorials/pendulum/7_reset_routine.ipynb">Tutorial
7: Reset Routines</a></li>
</ol>
</section>

<section class="section">
<h2 class="title has-text-centered" id="speakers">Speakers</h2>

Expand Down
18 changes: 0 additions & 18 deletions notebooks/optuna_lab.ipynb
Expand Up @@ -10,24 +10,6 @@
"<a href=\"https://colab.research.google.com/github/araffin/tools-for-robotic-rl-icra2022/blob/main/notebooks/optuna_lab.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "hxkD_v3JXwyD"
},
"source": [
"# Outlook #"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "RMfcHxgWX0ms"
},
"source": [
"This colab explains how to tune the hyper-parameters of reinforcement learnign algorithms coded in stable-baselines 3 so as to maximize the final performance of the trained agents."
]
},
{
"cell_type": "markdown",
"metadata": {
Expand Down