Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

n_actions=12 #3

Closed
Shantan243 opened this issue Apr 24, 2023 · 1 comment
Closed

n_actions=12 #3

Shantan243 opened this issue Apr 24, 2023 · 1 comment

Comments

@Shantan243
Copy link

Shantan243 commented Apr 24, 2023

Can i have detailed explaination of why 12 actions only - i mean, we can set price list as we wish. And also, how these 12 actions are impacting multiple buildings, say 10 buildings in this repo. Will 12 actions hit each of the buildings simultaneously or 1 action per building or a combination of actions per building..

@Cernewein
Copy link
Owner

Hi,

This was done in order to discretize the action space, which simplifies training a lot. At one timestep on action is chosen (one price), and this same price is sent to all individual buildings.
You can increase the number of actions but it makes it harder to explore all of the action space, 12 seemed like a reasonable trade off between action granularity and training complexity.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants