New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Enabled per channel quantized static linear/conv #37622
Conversation
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: [ghstack-poisoned]
💊 CI failures summary and remediationsAs of commit 8725f83 (more details on the Dr. CI page):
ci.pytorch.org: 1 failedThis comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.Please report bugs/suggestions on the GitHub issue tracker or post in the (internal) Dr. CI Users group. This comment has been revised 126 times. |
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized test on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: ghstack-source-id: 3ad2892fb90e634d48f56d860a942e98b0c70639 Pull Request resolved: pytorch/pytorch#37622
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
// Need to move the check here since we are releasing the weights. | ||
TORCH_CHECK( | ||
orig_weight.qscheme() == at::kPerTensorAffine, | ||
"quantized::linear_dynamic (qnnpack) only supports " | ||
"Per Tensor Quantization Scheme"); |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't get this. Can the scheme change between when you call prepack and here? Also, I think I understand "move" in the context of this diff, but I don't think someone looking at the new version of the code in the future will understand what's moving here.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This will be removed by a later PR in the stack. I just split the PRs for ease of review and ease of dissecting any future failures. I do understand though it is a cryptic comment.
Regarding qscheme changing. I don't think this is possible. Do you have a reason to believe that it can?
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
Summary: Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow. Test Plan: pytest test/quantization/test_quantized.py pytest test/quantization/test_quantized_module.py Reviewers: Subscribers: Tasks: Tags: Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046) [ghstack-poisoned]
This pull request has been merged in b8eae1e. |
Stack from ghstack:
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.
Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py
Reviewers:
Subscribers:
Tasks:
Tags:
Differential Revision: D21339046