Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make Gaussian initial std configurable #30

Closed
michaelschaarschmidt opened this issue Jul 14, 2017 · 2 comments
Closed

Make Gaussian initial std configurable #30

michaelschaarschmidt opened this issue Jul 14, 2017 · 2 comments
Assignees

Comments

@michaelschaarschmidt
Copy link
Contributor

From #26:

'Another thing I noticed in continuous state spaces is that the standard deviation of the Gaussian (exploration) noise is not parameterized. That seems like a bad default for this kind of on-policy method. It's an easy fix since the required code in the Gaussian class is just commented out, but enabling this does not seem possible without low-level adjustments at the moment.'

@michaelschaarschmidt
Copy link
Contributor Author

Further issue:

Another thing that might be nice to add to the library is the ability to query the action without any exploration noise. This could come, for example, in the form of an exploration=True keyword in agent.act(). In the case where the policy is stochastic this could boil down to evaluating the mean model, which would require some minor internal changes.

@AlexKuhnle
Copy link
Member

Both integrated.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants