Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUANTIZE] Refactor quantization codebase and fix model accuracy #3762

wants to merge 8 commits into from


Copy link

ZihengJiang commented Aug 13, 2019

A mirror PR of #3543 due to CI error.

  • Separate quantization code base into different files:,,
  • Change rewrite_for_vta to extra partition pass and enable it by default
  • Change annotation.force_cast(x) to annotation.cast_hint(x, dtype)
  • Remove qconfig.store_lowbit_output and enable it by default
  • Fixed accuracy of models like mobilenet:
    • resnet18_v1(8-16bit): 69.29%
    • resnet18_v1(8-32bit): 69.29%
    • resnet34_v1: 73.33%
    • resnet50_v1: 74.78%
    • resnet101_v1: 75.66%
    • mobilenetv2_1.0: 66.64%
ZihengJiang added 5 commits Jul 14, 2019

This comment has been minimized.

Copy link

tmoreau89 commented Aug 13, 2019

@nhynes do you happen to know why the rust CI error is occurring on this PR? Thanks!

ZihengJiang added 3 commits Aug 15, 2019

This comment has been minimized.

Is it possible to tell the exact command line to generate this file? I am following the tutorial of gluon, it does not work on this script.

@ZihengJiang ZihengJiang deleted the ZihengJiang:quantize-test-ci branch Aug 15, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

3 participants
You can’t perform that action at this time.