New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[3/n] loading meta to device #100495
[3/n] loading meta to device #100495
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/100495
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit c968898: This comment was automatically generated by Dr. CI and updates every 15 minutes. |
This pull request was exported from Phabricator. Differential Revision: D45099145 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good.
This pull request was exported from Phabricator. Differential Revision: D45099145 |
Summary: Pull Request resolved: pytorch#100495 Make it possible to `torch.jit.load(model, device)` to a device when `model` contains weights that are on device `meta`. Just leave the `meta` weights on `meta`, and load the weights that can be loaded to the target device. Reviewed By: houseroad Differential Revision: D45099145 fbshipit-source-id: 4cf3cc9d46409c48ade737937fded1491f8361d2
Summary: Pull Request resolved: pytorch#100495 Make it possible to `torch.jit.load(model, device)` to a device when `model` contains weights that are on device `meta`. Just leave the `meta` weights on `meta`, and load the weights that can be loaded to the target device. Reviewed By: houseroad Differential Revision: D45099145 fbshipit-source-id: a7e477e0632c55bfa4827a2183164f07ab1ee7da
This pull request was exported from Phabricator. Differential Revision: D45099145 |
@pytorchbot merge (Initiating merge automatically since Phabricator Diff has merged) |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Summary: Make it possible to
torch.jit.load(model, device)
to a device whenmodel
contains weights that are on devicemeta
. Just leave themeta
weights onmeta
, and load the weights that can be loaded to the target device.Reviewed By: singlaiiit, RoshanPAN, sayitmemory
Differential Revision: D45099145