-
Notifications
You must be signed in to change notification settings - Fork 25.4k
dbr quant: move model level utils into own file #68346
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Summary: Some utility functions for DBR quant need to be aware of `AutoQuantizationState`. This PR moves them into their own file, so they can use the type directly without circular imports, and removes the mypy ignores which are no longer necessary after this change. Test plan: ``` python test/test_quantization.py TestQuantizeDBR ``` [ghstack-poisoned]
CI Flow Status⚛️ CI FlowRuleset - Version:
You can add a comment to the PR and tag @pytorchbot with the following commands: # ciflow rerun, "ciflow/default" will always be added automatically
@pytorchbot ciflow rerun
# ciflow rerun with additional labels "-l <ciflow/label_name>", which is equivalent to adding these labels manually and trigger the rerun
@pytorchbot ciflow rerun -l ciflow/scheduled -l ciflow/slow For more information, please take a look at the CI Flow Wiki. |
🔗 Helpful links
💊 CI failures summary and remediationsAs of commit b48d191 (more details on the Dr. CI page): 💚 💚 Looks good so far! There are no failures yet. 💚 💚 This comment was automatically generated by Dr. CI (expand for details).Please report bugs/suggestions to the (internal) Dr. CI Users group. |
Summary: Some utility functions for DBR quant need to be aware of `AutoQuantizationState`. This PR moves them into their own file, so they can use the type directly without circular imports, and removes the mypy ignores which are no longer necessary after this change. Test plan: ``` python test/test_quantization.py TestQuantizeDBR ``` [ghstack-poisoned]
@vkuzo has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator. |
Summary: Some utility functions for DBR quant need to be aware of `AutoQuantizationState`. This PR moves them into their own file, so they can use the type directly without circular imports, and removes the mypy ignores which are no longer necessary after this change. Test plan: ``` python test/test_quantization.py TestQuantizeDBR ``` Differential Revision: [D32463763](https://our.internmc.facebook.com/intern/diff/D32463763) [ghstack-poisoned]
@vkuzo has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator. |
Summary: Some utility functions for DBR quant need to be aware of `AutoQuantizationState`. This PR moves them into their own file, so they can use the type directly without circular imports, and removes the mypy ignores which are no longer necessary after this change. Test plan: ``` python test/test_quantization.py TestQuantizeDBR ``` Differential Revision: [D32463763](https://our.internmc.facebook.com/intern/diff/D32463763) [ghstack-poisoned]
@vkuzo has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator. |
Summary: Some utility functions for DBR quant need to be aware of `AutoQuantizationState`. This PR moves them into their own file, so they can use the type directly without circular imports, and removes the mypy ignores which are no longer necessary after this change. Test plan: ``` python test/test_quantization.py TestQuantizeDBR ``` Differential Revision: [D32463763](https://our.internmc.facebook.com/intern/diff/D32463763) [ghstack-poisoned]
@vkuzo has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator. |
Summary: Some utility functions for DBR quant need to be aware of `AutoQuantizationState`. This PR moves them into their own file, so they can use the type directly without circular imports, and removes the mypy ignores which are no longer necessary after this change. Test plan: ``` python test/test_quantization.py TestQuantizeDBR ``` Differential Revision: [D32463763](https://our.internmc.facebook.com/intern/diff/D32463763) [ghstack-poisoned]
@vkuzo has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator. |
Stack from ghstack:
op_convert_before_hook
#68371 dbr quant overhead[6/x]: remove unneeded isinstance checks inop_convert_before_hook
get_quantized_op
to only useseen_op_info
#68342 dbr quant: refactorget_quantized_op
to only useseen_op_info
get_func_output_obs_type
to only useseen_op_info
#68341 dbr quant: refactorget_func_output_obs_type
to only useseen_op_info
Summary:
Some utility functions for DBR quant need to be aware
of
AutoQuantizationState
. This PR moves them into their own file, so theycan use the type directly without circular imports, and removes the mypy
ignores which are no longer necessary after this change.
Test plan:
Differential Revision: D32463763