Skip to content
This repository has been archived by the owner on Dec 11, 2022. It is now read-only.

Multi-thread same as multi-seed? #144

Closed
davidsonic opened this issue Dec 9, 2018 · 1 comment
Closed

Multi-thread same as multi-seed? #144

davidsonic opened this issue Dec 9, 2018 · 1 comment

Comments

@davidsonic
Copy link

davidsonic commented Dec 9, 2018

Can I understand -n command as an extension to multi-seed running? It seems to me that multi-processing is like creating more uncorrelated samples for training, and run multiple tests (possibly with different seeds, I haven't looked into details). I know that in many papers, different-seed results are often required. Since the timestep logging for each worker are same, I assume -n doesn't bring speed advantage but lower variance and possible advantages based on this, right? Thank you!

@galnov
Copy link
Member

galnov commented Dec 18, 2018

The -n flag enables single-node multi-thread training, where multiple agents are training in parallel.
It brings speed advantage vs. the single-node single-thread training, as demonstrated in Figure 4 of the Asynchronous Methods for Deep Reinforcement Learning paper.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants