Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

MPI with hindsight experience replay #452

Open
jainachin opened this issue Aug 22, 2019 · 4 comments
Open

MPI with hindsight experience replay #452

jainachin opened this issue Aug 22, 2019 · 4 comments
Labels
enhancement New feature or request question Further information is requested

Comments

@jainachin
Copy link

Seems like multiprocess parallelization is not supported with HER. Is there a plan to support it?
@araffin
Copy link
Collaborator

araffin commented Aug 23, 2019 •
edited
Loading

MPI support depends on the algorithm you use with HER. For instance, DDPG supports it but SAC, DQN and TD3 don't (cf #424).
There is no current plan to add support for the others for now. I would prefer adding support for vectorized environments.

@araffin araffin added enhancement New feature or request question Further information is requested labels Aug 23, 2019
@acyclics
Copy link

acyclics commented Oct 1, 2019

@araffin I want to give this enhancement a try (hands-on learning for myself). Would that be alright?

@araffin
Copy link
Collaborator

araffin commented Oct 1, 2019

Would that be alright?

Sure, for which algorithm?

@acyclics
Copy link

acyclics commented Oct 1, 2019

Would that be alright?

Sure, for which algorithm?

TD3

@acyclics acyclics mentioned this issue Oct 3, 2019
Open
@araffin araffin mentioned this issue Dec 6, 2019
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
enhancement New feature or request question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@araffin @jainachin @acyclics