Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enabled per channel quantized static linear/conv #37622

Closed
wants to merge 25 commits into from

Conversation

kimishpatel
Copy link
Contributor

@kimishpatel kimishpatel commented Apr 30, 2020

Stack from ghstack:

Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: D21339046

Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
@dr-ci
Copy link

dr-ci bot commented Apr 30, 2020

💊 CI failures summary and remediations

As of commit 8725f83 (more details on the Dr. CI page):


  • 1/1 failures possibly* introduced in this PR
    • 1/1 non-CircleCI failure(s)

ci.pytorch.org: 1 failed


This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker or post in the (internal) Dr. CI Users group.

See how this bot performed.

This comment has been revised 126 times.

Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
@kimishpatel kimishpatel mentioned this pull request May 5, 2020
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
xuezhou1998 pushed a commit to xuezhou1998/new_pytorch that referenced this pull request May 9, 2020
Summary:
Enable channelwise quantized test on qlinear and qconv.
Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 3ad2892fb90e634d48f56d860a942e98b0c70639
Pull Request resolved: pytorch/pytorch#37622
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Comment on lines +283 to +287
// Need to move the check here since we are releasing the weights.
TORCH_CHECK(
orig_weight.qscheme() == at::kPerTensorAffine,
"quantized::linear_dynamic (qnnpack) only supports "
"Per Tensor Quantization Scheme");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't get this. Can the scheme change between when you call prepack and here? Also, I think I understand "move" in the context of this diff, but I don't think someone looking at the new version of the code in the future will understand what's moving here.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will be removed by a later PR in the stack. I just split the PRs for ease of review and ease of dissecting any future failures. I do understand though it is a cryptic comment.
Regarding qscheme changing. I don't think this is possible. Do you have a reason to believe that it can?

Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
Summary:
Enable channelwise quantized tests on qlinear and qconv. Dynmaic linear to follow.

Test Plan:
pytest test/quantization/test_quantized.py
pytest test/quantization/test_quantized_module.py

Reviewers:

Subscribers:

Tasks:

Tags:

Differential Revision: [D21339046](https://our.internmc.facebook.com/intern/diff/D21339046)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in b8eae1e.

@facebook-github-bot facebook-github-bot deleted the gh/kimishpatel/16/head branch May 24, 2020 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants