Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Revisit Launcher for starting multiple experiments #1121

Closed
MischaPanch opened this issue Apr 21, 2024 · 1 comment · Fixed by #1141
Closed

Revisit Launcher for starting multiple experiments #1121

MischaPanch opened this issue Apr 21, 2024 · 1 comment · Fixed by #1141
Labels
enhancement Feature that is not a new algorithm or an algorithm enhancement experiment-eval Issues about evaluation: plots, stats, multiprocessing etc. minor Requires small changes to be fixed

Comments

@MischaPanch
Copy link
Collaborator

I couldn't make it work on ubuntu (loky fails with pickling error, multiprocessing fails with daemonic process can't have children), and it generally is of limited use to start experiments in parallel on a single machine, unless there are a lot of CPUs.

The one thing that might work and actually make sense is a ray launcher. We could also borrow a launcher from hydra, though it might be cumbersome.

An LLM with coding abilities can likely implement a ray based launcher almost out of the box

@MischaPanch MischaPanch added enhancement Feature that is not a new algorithm or an algorithm enhancement minor Requires small changes to be fixed experiment-eval Issues about evaluation: plots, stats, multiprocessing etc. labels Apr 21, 2024
@maxhuettenrauch
Copy link
Collaborator

I don't know why, but it works if you ask for VectorEnvType.SUBPROC_SHARED_MEM_FORK_CONTEXT (instead of VectorEnvType.SUBPROC_SHARED_MEM)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Feature that is not a new algorithm or an algorithm enhancement experiment-eval Issues about evaluation: plots, stats, multiprocessing etc. minor Requires small changes to be fixed
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants