New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FSDP] Refactor comm hooks directory #85496
Conversation
Move FSDP comm hooks into FSDP folder, expose the reduced precision hooks in torch.distributed.fsdp.default_comm_hooks namespace Differential Revision: [D39743042](https://our.internmc.facebook.com/intern/diff/D39743042/) [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/85496
Note: Links to docs will display an error until the docs builds have been completed. ❌ 2 FailuresAs of commit d71267b: The following jobs have failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
Move FSDP comm hooks into FSDP folder, expose the reduced precision hooks in torch.distributed.fsdp.default_comm_hooks namespace Differential Revision: [D39743042](https://our.internmc.facebook.com/intern/diff/D39743042/) ghstack-source-id: 168200563 Pull Request resolved: #85496
Move FSDP comm hooks into FSDP folder, expose the reduced precision hooks in torch.distributed.fsdp.default_comm_hooks namespace Differential Revision: [D39743042](https://our.internmc.facebook.com/intern/diff/D39743042/) [ghstack-poisoned]
Pull Request resolved: #85496 Move FSDP comm hooks into FSDP folder, expose the reduced precision hooks in torch.distributed.fsdp.default_comm_hooks namespace ghstack-source-id: 168203289 Differential Revision: [D39743042](https://our.internmc.facebook.com/intern/diff/D39743042/)
Move FSDP comm hooks into FSDP folder, expose the reduced precision hooks in torch.distributed.fsdp.default_comm_hooks namespace Differential Revision: [D39743042](https://our.internmc.facebook.com/intern/diff/D39743042/) [ghstack-poisoned]
Pull Request resolved: #85496 Move FSDP comm hooks into FSDP folder, expose the reduced precision hooks in torch.distributed.fsdp.default_comm_hooks namespace ghstack-source-id: 168203649 Differential Revision: [D39743042](https://our.internmc.facebook.com/intern/diff/D39743042/)
/easycla As part of the transition to the PyTorch Foundation, this project now requires contributions be covered under the new CLA. See #85559 for additional details. This comment will trigger a new check of this PR. If you are already covered, you will simply see a new "EasyCLA" check that passes. If you are not covered, a bot will leave a new comment with a link to sign. |
Move FSDP comm hooks into FSDP folder, expose the reduced precision hooks in torch.distributed.fsdp.default_comm_hooks namespace. Also a few small refactors. Differential Revision: [D39743042](https://our.internmc.facebook.com/intern/diff/D39743042/) [ghstack-poisoned]
Pull Request resolved: #85496 Move FSDP comm hooks into FSDP folder, expose the reduced precision hooks in torch.distributed.fsdp.default_comm_hooks namespace ghstack-source-id: 93958491eb946b798364f34c7c3953317e8ef71f Differential Revision: [D39743042](https://our.internmc.facebook.com/intern/diff/D39743042/)
Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as |
Stack from ghstack (oldest at bottom):
Move FSDP comm hooks into FSDP folder, expose the reduced precision
hooks in torch.distributed.fsdp.default_comm_hooks namespace. Also a few small refactors.
Differential Revision: D39743042
cc @mrshenli @pritamdamania87 @zhaojuanmao @satgera @gqchen @aazzolini @osalpekar @jiayisuse @H-Huang @kwen2501 @awgu