Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add 5min, 10 min etc delta of BG as an observation #5

Closed
harispoljo opened this issue Feb 18, 2019 · 1 comment
Closed

Add 5min, 10 min etc delta of BG as an observation #5

harispoljo opened this issue Feb 18, 2019 · 1 comment

Comments

@harispoljo
Copy link

Add delta of BG to the observation when using gym.

@jxx123
Copy link
Owner

jxx123 commented Feb 19, 2019

Hi harispolijo,

Thanks for your comment. Can you give me more details on why you need the delta BG in the observation? I believe the delta BG values can be computed inside of the controller policy. You should be able to cache the historical BG values as states in the controller, and compute the delta BG in the policy. Adding delta BG into the observation will increase the observation space, which might not always be a desired feature in general reinforcement learning algorithm development. I prefer to leave the flexibility to the users. Let me know what you think.

Jinyu

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants