v0.10.0

Hexagon HTP

Microsoft-signed HTP catalog (llama.cpp @ 19cce6). No cert import required on Windows on Snapdragon.

What's Changed

• fix(sdk): support flattened llama plugin layout by RemiliaForever (@RemiliaForever) in #1562
• fix(cli): trim trailing slash from proxy env URLs by Mengsheng Wu (@mengshengwu) in #1565
• fix(cli): keep reasoning inline for run by RemiliaForever (@RemiliaForever) in #1566
• feat(server): report version, uptime and keepalive in /status by Mengsheng Wu (@mengshengwu) in #1568
• fix(sdk): repair llama_cpp prompt prefix reuse by RemiliaForever (@RemiliaForever) in #1567
• fix(sdk): load nested plugin libraries on Android by RemiliaForever (@RemiliaForever) in #1571
• fix(sdk): retry interrupted HTTP range streams by RemiliaForever (@RemiliaForever) in #1573
• feat(sdk): expose QAIRT optrace configuration by David Qian (@Davidqian123) in #1575
• feat(server): add Prometheus /metrics endpoint by Mengsheng Wu (@mengshengwu) in #1570
• feat(server): add GET /health endpoint by Mengsheng Wu (@mengshengwu) in #1569
• perf(sdk): reduce unused VLM logits allocation by Jaehyup (Jay) Shin (@shin0343) in #1564
• feat(cli): add serve inference defaults by RemiliaForever (@RemiliaForever) in #1574
• fix(python): don't stream tokens the SDK rejected on cancel by Jaehyup (Jay) Shin (@shin0343) in #1577
• ci(ci): bench by org/name:quant id with descriptive run names by Mengsheng Wu (@mengshengwu) in #1578
• ci(qdc): skip three slow CPU cases on the QCS9075M leg by Mengsheng Wu (@mengshengwu) in #1579
• fix(server): suppress empty Gemma 4 thought markers by RemiliaForever (@RemiliaForever) in #1586
• fix(server): apply inline grammar to chat completions by RemiliaForever (@RemiliaForever) in #1587
• fix(sdk): invalidate stale progress markers by ANIRUDDHA ADAK (@aniruddhaadak80) in #1488
• fix(sdk): reject malformed ZIP64 metadata by ANIRUDDHA ADAK (@aniruddhaadak80) in #1490
• fix(ci): install ca-certificates in the Android QDC Termux bundle by Mengsheng Wu (@mengshengwu) in #1585
• test(sdk): route stale bitmap test through chunk size init by Mengsheng Wu (@mengshengwu) in #1588
• chore(deps): bump pypa/gh-action-pypi-publish from 1.14.2 to 1.14.3 by Dependabot (@dependabot)[bot] in #1591
• fix(server): route GPT-OSS channels through tool-call scanner by RemiliaForever (@RemiliaForever) in #1589
• ci(build): bump Hexagon SDK to 6.7.0.0 and toolchain to v0.8 by Mengsheng Wu (@mengshengwu) in #1583
• feat(sdk)!: propagate chat-template grammar to samplers by RemiliaForever (@RemiliaForever) in #1593
• chore(deps): bump docker/login-action from 4.6.0 to 4.7.0 by Dependabot (@dependabot)[bot] in #1597
• feat(server): add Spark2.5 tool-call support by RemiliaForever (@RemiliaForever) in #1598
• feat(sdk): support Qwen3-8B-Eaglet in the qairt plugin by David Qian (@Davidqian123) in #1580
• perf(sdk): row-split llama_cpp HTP devices across both NPUs on IQ9 by Mengsheng Wu (@mengshengwu) in #1600
• chore(sdk): bump llama.cpp submodule to 7aca0d2ea by Mengsheng Wu (@mengshengwu) in #1599
• ci(qdc): split QDC into a PR smoke tier and a nightly full tier by Mengsheng Wu (@mengshengwu) in #1601
• docs(release): update HTP signing steps to match current ATT flow by Mengsheng Wu (@mengshengwu) in #1608
• feat(server)!: add parallel tool-call controls by RemiliaForever (@RemiliaForever) in #1603
• fix(server): forward chat stop parameters by RemiliaForever (@RemiliaForever) in #1609
• fix(server): parse Ministral3 tool calls and reasoning by RemiliaForever (@RemiliaForever) in #1613
• refactor(cli): modernize Go syntax by RemiliaForever (@RemiliaForever) in #1614
• ci(build): save SDK build caches only from main by Mengsheng Wu (@mengshengwu) in #1612
• fix(server): classify invalid chat media as client errors by RemiliaForever (@RemiliaForever) in #1611
• chore(sdk): bump llama.cpp to 19cce6919 by David Qian (@Davidqian123) in #1616

New Contributors

• Jaehyup (Jay) Shin (@shin0343) made their first contribution in #1564
• ANIRUDDHA ADAK (@aniruddhaadak80) made their first contribution in #1488

Full Changelog: v0.9.2...v0.10.0