Skip to content

Add support for tensor-wise mixed precision in Quark onnx quantization#2252

Merged
jambayk merged 3 commits intomicrosoft:mainfrom
gengxinwu:support-mixed-precision
Nov 13, 2025
Merged

Add support for tensor-wise mixed precision in Quark onnx quantization#2252
jambayk merged 3 commits intomicrosoft:mainfrom
gengxinwu:support-mixed-precision

Conversation

@gengxinwu
Copy link
Contributor

Describe your changes

Add support for tensor-wise mixed precision in Quark onnx quantization.

It supports specifying quantization data types for specific tensors, how to configure it please refer to the newly added testcase.

Checklist before requesting a review

  • Add unit tests for this change.
  • Make sure all tests can pass.
  • Update documents if necessary.
  • Lint and apply fixes to your code by running lintrunner -a
  • Is this a user-facing change? If yes, give a description of this change to be included in the release notes.

(Optional) Issue link

@jambayk
Copy link
Contributor

jambayk commented Nov 12, 2025

@gengxinwu please agree to the CLA following the bot instruction above. thanks!

@jambayk jambayk merged commit 1bed68f into microsoft:main Nov 13, 2025
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants