Skip to content

Commit

Permalink
Revised the wording of observation and action space
Browse files Browse the repository at this point in the history
  • Loading branch information
ashkan-software committed Jul 9, 2019
1 parent 70a78d9 commit d9fc018
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions tutorials/tutorial11_traffic_lights.ipynb
Expand Up @@ -427,7 +427,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Based on the need, the action space can be defined in a different way In this example, the action space for RL-controlled traffic lights directly matches the number of traffic intersections in the system. Each intersection (traffic light node) corresponds to an action. The action space is thus defined as:"
"The action space may be any set of actions the user wishes the agent to do. In this example, the action space for RL-controlled traffic lights directly matches the number of traffic intersections in the system. Each intersection (traffic light node) corresponds to an action. The action space is thus defined as:"
]
},
{
Expand Down Expand Up @@ -466,7 +466,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Based on the need, the observation space can be defined in a different way. The existing observation space for our existing traffic lights experiments is designed to be a fully observable state space with the following metrics. For each vehicle, we want to know its velocity, its distance (in [unit]) from the next intersection, and the unique edge it is traveling on. For each traffic light, we want to know its current state (i.e. what direction it is flowing), when it last changed, and whether it was yellow. "
"The observation space may be any set of state information the user wishes to provide to the agent. This information may fully or partially describe the state of the environment. The existing observation space for our existing traffic lights experiments is designed to be a fully observable state space with the following metrics. For each vehicle, we want to know its velocity, its distance (in [unit]) from the next intersection, and the unique edge it is traveling on. For each traffic light, we want to know its current state (i.e. what direction it is flowing), when it last changed, and whether it was yellow. "
]
},
{
Expand Down

0 comments on commit d9fc018

Please sign in to comment.