Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ball does not appear without FIRE action in Atari Breakout environment #401

Closed
kdkyum opened this issue Nov 2, 2016 · 3 comments
Closed

Comments

@kdkyum
Copy link

kdkyum commented Nov 2, 2016

Breakout have following action space
['NOOP', 'FIRE', 'RIGHT', 'LEFT', 'RIGHTFIRE', 'LEFTFIRE']

The ball in the Breakout atari game does not appear until one of ['FIRE', 'RIGHTFIRE', 'LEFTFIRE'] actions is executed.
I understand this FIRE action make the game start for human player, but this is unnecessary in learning procedure.

@tlbtlbtlb
Copy link
Contributor

It may be unnecessary, but a reasonable learning algorithm shouldn't have much trouble learning it. Changing the semantics of an environment makes new researcher's results not comparable to old results, so we avoid changing them unless there's a compelling reason.

@koulanurag
Copy link
Contributor

May I know the right place to look for description of each action in a specific environment?

Thanks for any reference

@tlbtlbtlb
Copy link
Contributor

The games themselves aren't documented anywhere. You can play them using the the emulator Stella to understand what the controls do.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants