-
Notifications
You must be signed in to change notification settings - Fork 25.7k
PT1 Stable Release Distributed Documentation #14444
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@teng-li has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.
|
|
||
| PyTorch distributed currently only supports Linux. By default, two backends: NCCL and Gloo | ||
| will be built and included in PyTorch distributed, when CUDA is available. MPI is an | ||
| optional backend that can only be included if you build PyTorch from source. (e.g. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should this be i.e. instead of e.g.?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
e.g. should be fine, that's what I meant initially
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@teng-li is landing this pull request. If you are a Facebook employee, you can view this diff on Phabricator.
The doc covers pretty much all we have had on distributed for PT1 stable release, tracked in #14080
Tested by previewing the sphinx generated webpages. All look good.