Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

procgen #1

Closed
hlsafin opened this issue May 1, 2022 · 2 comments
Closed

procgen #1

hlsafin opened this issue May 1, 2022 · 2 comments

Comments

@hlsafin
Copy link

hlsafin commented May 1, 2022

Is it possible to create the testing env for procgen so that you can see the generalization performance? I am having difficult implementing it, since i'm using from 'procgen import ProcgenEnv".

Thank you

@schmidtdominik
Copy link
Owner

You can modify the env_wrappers.create_procgen_env function to create the procgen env with other parameters (such as specific seeds). For example, set it to use a fixed set of seeds during training and then evaluate it on a different set. Does that help?

@hlsafin
Copy link
Author

hlsafin commented May 3, 2022

Right, but the idea being you need two sets of different environment, correct? one only has access to, lets say 500 seed, and the testing env has access to any random seed. And you want to stop learning when your on the test env.

I tried doing this approach but its quite difficult with SubprocVec, DummyVec since there seems to be memory leak somewhere.

Also, there is memory leak issue even with other environments, I'm not sure if your facing the same issues as I am. If possible, maybe you can list all the dependencies your currently running on your environment(or create dockerfile). Sorry if this is too much to ask. I'm very interested your implementation, and your work is awesome!
Thank you

@hlsafin hlsafin closed this as completed May 15, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants