New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
support bias shift in outlier suppression+ #1231
base: master
Are you sure you want to change the base?
Conversation
Is this PR target for v2.4? |
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
neural_compressor/adaptor/onnxrt.py
Outdated
@@ -181,6 +181,7 @@ def smooth_quant( | |||
"alpha_step": 0.1, | |||
"shared_criterion": "mean", | |||
"do_blockwise": False, | |||
"shift_bias": False, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
how about using **kwargs, otherwise, each time we need to add the keywords for different backends
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
auto_alpha_args is already added to kwargs in /algorithm/smooth_quant.py.
Just adding the arguments and related docstrings for onnx and tensorflow.
for more information, see https://pre-commit.ci
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
Signed-off-by: Lu, Yintong <yintong.lu@intel.com>
As discussed, bias shift will be a separate module, so this pr will not be merged |
Type of Change
feature
Description
enable bias-shifting of outlier suppression + in SQ
Note: this is still under development and debugging
Expected Behavior & Potential Risk
How has this PR been tested?
Dependency Change?
no library dependency introduced or removed