New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Docs] Updating init_process_group docs to indicate correct rank range #49131
Conversation
This pull request was exported from Phabricator. Differential Revision: D25410532 |
Codecov Report
@@ Coverage Diff @@
## master #49131 +/- ##
=======================================
Coverage 80.62% 80.62%
=======================================
Files 1875 1875
Lines 202772 202772
=======================================
+ Hits 163477 163485 +8
+ Misses 39295 39287 -8 |
pytorch#49131) Summary: Pull Request resolved: pytorch#49131 Users frequently assume the correct range of ranks is 1 ... `world_size`. This PR udpates the docs to indicate that the correct rank range users should specify is 0 ... `world_size` - 1. Test Plan: Rendering and Building Docs Differential Revision: D25410532 fbshipit-source-id: dbef6394c327c93395528f5aff3e645ae392883f
This pull request was exported from Phabricator. Differential Revision: D25410532 |
f50c540
to
d4cd4a0
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for fixing!
This pull request has been merged in 4b3f05a. |
@@ -382,7 +382,8 @@ def init_process_group(backend, | |||
Mutually exclusive with ``store``. | |||
world_size (int, optional): Number of processes participating in | |||
the job. Required if ``store`` is specified. | |||
rank (int, optional): Rank of the current process. | |||
rank (int, optional): Rank of the current process (it should be a |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@osalpekar Should we do this for new_group
too?
pytorch#49131) Summary: Pull Request resolved: pytorch#49131 Users frequently assume the correct range of ranks is 1 ... `world_size`. This PR udpates the docs to indicate that the correct rank range users should specify is 0 ... `world_size` - 1. Test Plan: Rendering and Building Docs Reviewed By: mrshenli Differential Revision: D25410532 fbshipit-source-id: fe0f17a4369b533dc98543204a38b8558e68497a
Summary:
Users frequently assume the correct range of ranks is (1 ...
world_size
).This PR updates the docs to indicate that the correct rank range
users should specify is (0 ...
world_size
- 1).Test Plan: Rendering and Building Docs
Differential Revision: D25410532