Skip to content

Support Qwen3 ASR 1.7B HF checkpoints - #43

Merged
0xShug0 merged 1 commit into
0xShug0:mainfrom
mirek190:agent/qwen3-asr-1-7b-hf
Jul 12, 2026
Merged

Support Qwen3 ASR 1.7B HF checkpoints#43
0xShug0 merged 1 commit into
0xShug0:mainfrom
mirek190:agent/qwen3-asr-1-7b-hf

Conversation

@mirek190

@mirek190 mirek190 commented Jul 12, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add support for loading official Qwen/Qwen3-ASR-1.7B-hf checkpoints
  • support the flat Hugging Face configuration, processor metadata, tokenizer format, tensor namespaces, and tied language-model output used by the 1.7B model
  • retain compatibility with Qwen3-ASR 0.6B
  • update the model manager and documentation for the new model

Why

The official Qwen3-ASR 1.7B Hugging Face checkpoint differs from the existing 0.6B layout and could not be loaded directly by audio.cpp.

Validation

  • built and tested the Windows CPU CLI
  • built and tested the Windows CUDA CLI and server
  • inspected both Qwen3-ASR 1.7B and 0.6B checkpoint layouts
  • ran real Japanese WAV inference on an RTX 3090
  • tested the managed server and model-manager workflows

@mirek190 mirek190 changed the title Support Qwen3 ASR 1.7B HF checkpoints Support Qwen3 ASR 1.7B HF checkpoints alongside to Qwen3 ASR 0.6b Jul 12, 2026
@mirek190
mirek190 marked this pull request as ready for review July 12, 2026 10:41
@mirek190 mirek190 changed the title Support Qwen3 ASR 1.7B HF checkpoints alongside to Qwen3 ASR 0.6b Support Qwen3 ASR 1.7B checkpoints alongside to Qwen3 ASR 0.6b Jul 12, 2026
@mirek190 mirek190 changed the title Support Qwen3 ASR 1.7B checkpoints alongside to Qwen3 ASR 0.6b Support Qwen3 HF checkpoints and reusable GGUF loading Jul 12, 2026
@mirek190
mirek190 force-pushed the agent/qwen3-asr-1-7b-hf branch from c737f58 to 8c475bf Compare July 12, 2026 14:59
@mirek190 mirek190 changed the title Support Qwen3 HF checkpoints and reusable GGUF loading Support Qwen3 ASR 1.7B HF checkpoints Jul 12, 2026
@0xShug0

0xShug0 commented Jul 12, 2026

Copy link
Copy Markdown
Owner

@mirek190 Thanks for the PR! I’ll test it, and if everything looks good, I’ll merge it.

@mirek190

mirek190 commented Jul 12, 2026

Copy link
Copy Markdown
Contributor Author

No problem

I test it and seems working fine.
Tested with English and Japanese.
Also tested with Qwen3-ForcedAligner as a timestamp.

1.7b is much better than 0.6b

@0xShug0
0xShug0 merged commit 3982dfb into 0xShug0:main Jul 12, 2026
8 checks passed
@0xShug0

0xShug0 commented Jul 12, 2026

Copy link
Copy Markdown
Owner

@mirek190 merged! Thanks again for your contribution!

dleiferives pushed a commit to dleiferives/audio.cpp that referenced this pull request Jul 25, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants