Skip to content

Support kquant mixed for whisper export#28515

Merged
jiafatom merged 4 commits into
mainfrom
whisper_mixed
May 18, 2026
Merged

Support kquant mixed for whisper export#28515
jiafatom merged 4 commits into
mainfrom
whisper_mixed

Conversation

@jiafatom
Copy link
Copy Markdown
Contributor

Description

As titled.

Motivation and Context

whisper-small in int4-kquant-mixed is close to int8.

@jiafatom jiafatom requested a review from kunal-vaishnavi May 14, 2026 23:04
Copy link
Copy Markdown
Contributor

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can commit the suggested changes from lintrunner.

Comment thread onnxruntime/python/tools/transformers/models/whisper/convert_to_onnx.py Outdated
Comment thread onnxruntime/python/tools/transformers/quantize_helper.py
…nsion

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Comment thread onnxruntime/python/tools/transformers/models/whisper/convert_to_onnx.py Outdated
Comment thread onnxruntime/python/tools/transformers/models/whisper/convert_to_onnx.py Outdated
Comment thread onnxruntime/python/tools/transformers/models/whisper/convert_to_onnx.py Outdated
- Rename _get_sensitive_node_names to get_sensitive_node_names (public)
- Add type annotations to get_sensitive_node_names and make_quant_algo_config
- Simplify nested helper to a plain local def (no underscore prefix)

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copy link
Copy Markdown
Contributor

@github-actions github-actions Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can commit the suggested changes from lintrunner.

Comment thread onnxruntime/python/tools/transformers/models/whisper/convert_to_onnx.py Outdated
Agent-Logs-Url: https://github.com/microsoft/onnxruntime/sessions/c3d28491-c835-4b2a-a3f4-4e0ee59e183c

Co-authored-by: jiafatom <30608893+jiafatom@users.noreply.github.com>
@jiafatom jiafatom enabled auto-merge (squash) May 18, 2026 19:13
@jiafatom jiafatom merged commit d2453bc into main May 18, 2026
98 of 110 checks passed
@jiafatom jiafatom deleted the whisper_mixed branch May 18, 2026 23:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants