Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The same level of agents in the paper cannot be reproduced from the source code #3

Open
leoranlmia opened this issue Jun 29, 2023 · 0 comments

Comments

@leoranlmia
Copy link

Dear authors:
Thanks for sharing this code! This is a great work! However, when I try to train the robust agents with PGD solver, I cannot get the same level of agents of the paper.
After testing these agents, only get:

  • 0.0 +- 0.0 average reward in the Bankheist environment.
    image
  • 0.0 +- 0.0 average reward in the RoadRunner environment.
    image
  • 21.46 +- 1.6150541786577934 average reward in the Freeway environment.
    image
  • -21.0 +- 0.0 average reward in the Pong environment.
    image

Maybe my configured environment is the cause? Could you provide the exact version of python and main packages (torch, gym, numpy etc.)?
Or what else might be the cause?

Looking forward to hearing from you! Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant