-
Notifications
You must be signed in to change notification settings - Fork 25.7k
Fix all RuntimeErrors during weights_only load from being erroneously reported with the weights_only message #132349
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix all RuntimeErrors during weights_only load from being erroneously reported with the weights_only message #132349
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/132349
Note: Links to docs will display an error until the docs builds have been completed. ✅ No FailuresAs of commit c7fd26f with merge base 57d1ffc ( This comment was automatically generated by Dr. CI and updates every 15 minutes. |
…erroneously reported with the weights_only message" [ghstack-poisoned]
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not sure what's the impact of this change tbh. Is Pickle handling this type of error specially?
Also should we add a new unit test to ensure whatever this is fixing remains fixed?
|
@albanD main change is that we were always catching any RuntimeError (e.g. those that a corrupted checkpoint would cause) and reporting it with the |
|
But aren't other things maybe going to raise this type of error as well? Why use UnpicklingError vs WeightsOnlyFailureError ? |
|
Hm not sure how else would an |
|
Ho that sounds fair then. Feel free to keep it as is then! |
…erroneously reported with the weights_only message" Caught in above PR #127627 [ghstack-poisoned]
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
SGTM!
…erroneously reported with the weights_only message" Caught in above PR #127627 [ghstack-poisoned]
|
Rebased |
Tests on XLA shard not fixed yet but there is an issue here pytorch/xla#7799 Pull Request resolved: #127627 Approved by: https://github.com/albanD ghstack dependencies: #132349
Tests on XLA shard not fixed yet but there is an issue here pytorch/xla#7799 Pull Request resolved: pytorch#127627 Approved by: https://github.com/albanD ghstack dependencies: pytorch#132349
Caught in above PR #127627
Stack from ghstack (oldest at bottom):