What's Changed
- Fix LFM tool call parsing and bump version to 0.6.11 by @Blaizzy in #1792
- Fix Qwen3.5 ragged decode on GPUs that reject a 1024-thread threadgroup by @neil0306 in #1799
- fix(quant): honor per-layer quantization overrides for wrapped text models by @Lazarus-931 in #1791
- Fix Qwen3.5 structured output on checkpoints with a padded vocab by @Lazarus-931 in #1805
- Add qwen3 text backbone support to llmjpvl (Jagle-VL) by @takuyaomi in #1801
- feat(speculative): validate Laguna DFlash contract by @Thump604 in #1753
- server: add --max-num-seqs to bound concurrent batch size by @Lazarus-931 in #1782
- Honor explicit trust_remote_code in processor from_pretrained by @camparker in #1731
- Fix /v1/responses image reference output by @lucasnewman in #1806
- test: cover Chandra OCR2 config on the qwen3_5 path (#39) by @Lazarus-931 in #1809
- Split unterminated reasoning correctly when the prompt opens the thinking block by @Lazarus-931 in #1811
- embedding_loader: quantize pre-quantized weights before loading by @Lazarus-931 in #1773
- Add support for Minimax-H3 by @lucasnewman in #1808
- Keep serving when an optional model preload fails by @Lazarus-931 in #1814
- Quick fix to properly recoginze Bonsai Image models. by @dcartman in #1816
- Configure KV cache quantization per tensor by @Lazarus-931 in #1807
- Add Muse Glimmer model support by @Blaizzy in #1838
- Add Muse Glimmer ATEM tool parser by @Blaizzy in #1841
New Contributors
- @camparker made their first contribution in #1731
- @dcartman made their first contribution in #1816
Full Changelog: v0.6.10...v0.6.12
Contributors
dcartman, Blaizzy, and 6 other contributors