Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rainbow Hyperparameters #14

Closed
rfali opened this issue Nov 9, 2022 · 1 comment
Closed

Rainbow Hyperparameters #14

rfali opened this issue Nov 9, 2022 · 1 comment

Comments

@rfali
Copy link

rfali commented Nov 9, 2022

Hi. The paper mentions

Rainbow (Hessel et al., 2018) is based on Q-Learning and combines several advances, including for exploration. The defaults for Atari did not work well, so we tuned the hyper parameters for Crafter and found a compromise between Atari defaults and the data-efficient version of the method (van Hasselt et al., 2019) to be ideal.

Are these hyperparameters available anywhere, and if not, can you please share these? The crafter baselines for Rainbow has the same hyperparameters as Kaixhin's Rainbow (which are designed for ALE), and there are no hyper parameter values mentioned in the paper. Thanks for your time!

@danijar
Copy link
Owner

danijar commented Nov 10, 2022

Yes, those are the hyper parameters. I tried changing a handful of them but nothing I tried ended up working as well as the defaults.

@danijar danijar closed this as completed Nov 10, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants