New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[FSDP][optim_state_dict] Add device to _shard_utils.py to explicitly use the device from fsdp_state #109631
Conversation
…use the device from fsdp_state _get_pg_default_device does not always get the device we want. This PR let the user explicitly tell use the correct device. Differential Revision: [D49425743](https://our.internmc.facebook.com/intern/diff/D49425743/) [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/109631
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit 73d4909 with merge base 71b4b32 (): This comment was automatically generated by Dr. CI and updates every 15 minutes. |
…use the device from fsdp_state _get_pg_default_device does not always get the device we want. This PR let the user explicitly tell use the correct device. Differential Revision: [D49425743](https://our.internmc.facebook.com/intern/diff/D49425743/) ghstack-source-id: 201220846 Pull Request resolved: #109631
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Approved internally!
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM and please make sure the linter is happy
LGTM! |
…explicitly use the device from fsdp_state" _get_pg_default_device does not always get the device we want. This PR let the user explicitly tell use the correct device. Differential Revision: [D49425743](https://our.internmc.facebook.com/intern/diff/D49425743/) [ghstack-poisoned]
…use the device from fsdp_state Pull Request resolved: #109631 _get_pg_default_device does not always get the device we want. This PR let the user explicitly tell use the correct device. ghstack-source-id: 201245744 @exported-using-ghexport Differential Revision: [D49425743](https://our.internmc.facebook.com/intern/diff/D49425743/)
…explicitly use the device from fsdp_state" _get_pg_default_device does not always get the device we want. This PR let the user explicitly tell use the correct device. Differential Revision: [D49425743](https://our.internmc.facebook.com/intern/diff/D49425743/) [ghstack-poisoned]
…use the device from fsdp_state Pull Request resolved: #109631 _get_pg_default_device does not always get the device we want. This PR let the user explicitly tell use the correct device. ghstack-source-id: 201254722 @exported-using-ghexport Differential Revision: [D49425743](https://our.internmc.facebook.com/intern/diff/D49425743/)
@pytorchbot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Stack from ghstack (oldest at bottom):
_get_pg_default_device does not always get the device we want. This PR let the user explicitly tell use the correct device.
Differential Revision: D49425743