-
Notifications
You must be signed in to change notification settings - Fork 25.4k
[PyTorch Numeric Suite] Add module level comparison #36669
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) [ghstack-poisoned]
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) ghstack-source-id: 102210159 Pull Request resolved: #36669
💊 Build failures summary and remediationsAs of commit 82f1975 (more details on the Dr. CI page): 💚 💚 Looks good so far! There are no failures yet. 💚 💚 This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.Please report bugs/suggestions on the GitHub issue tracker. This comment has been revised 22 times. |
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) [ghstack-poisoned]
Pull Request resolved: #36669 Add module level comparison API. ghstack-source-id: 102385175 Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
q_module._modules[key] = value | ||
|
||
|
||
def compare_model_stub(float_model, q_model, module_swap_list, data, Logger=Logger): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Wondering if we need this as a top level function or keep this as an internal/test only function and move it to the test code.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Maybe we can keep it as top level function since it's easy for user to use as a one-liner to quickly check the model accuracy?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Sure, as long as we have the building blocks as user facing functions, we are ok.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Great start!. Few suggestions for further improvement
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) [ghstack-poisoned]
Address comments. |
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) [ghstack-poisoned]
Pull Request resolved: #36669 Add module level comparison API. ghstack-source-id: 102589374 Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good, have a few comments
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) [ghstack-poisoned]
Pull Request resolved: #36669 Add module level comparison API. ghstack-source-id: 102672767 Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) [ghstack-poisoned]
Pull Request resolved: #36669 Add module level comparison API. ghstack-source-id: 102713666 Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) [ghstack-poisoned]
Pull Request resolved: #36669 Add module level comparison API. ghstack-source-id: 102761562 Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
Add module level comparison API. Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/) [ghstack-poisoned]
Pull Request resolved: #36669 Add module level comparison API. ghstack-source-id: 102802362 Differential Revision: [D21045393](https://our.internmc.facebook.com/intern/diff/D21045393/)
This pull request has been merged in fba9b9a. |
Pull Request resolved: #36669 Add module level comparison API. ghstack-source-id: 102851307 Differential Revision: [D21231719](https://our.internmc.facebook.com/intern/diff/D21231719/)
Stack from ghstack:
Add module level comparison API.
Differential Revision: D21045393