v0.3.16

Hexagon HTP

Microsoft-signed HTP catalog (llama.cpp @ ae9291). No cert import required on Windows on Snapdragon.

What's Changed

• docs: simplify Docker install to Docker Hub only by Zack Li (@zhiyuan8) in #1139
• docs(dx): add same NPU troubleshooting to Chinese docs by Perry Cheng (@zhycheng614) in #1142
• feat(server): add server-wide nctx/ngl/compute defaults to serve by RemiliaForever (@RemiliaForever) in #1141
• fix(ci): unify source license headers to BSD-3-Clause by RemiliaForever (@RemiliaForever) in #1144
• docs: drop HOME export step from Linux ARM64 install by Alan Zhu (@alanzhuly) in #1145
• fix(python): fix VLM multi-turn image guard and test message order by Mengsheng Wu (@mengshengwu) in #1130
• fix(sdk): report qairt prefill rate over padded prompt length by RemiliaForever (@RemiliaForever) in #1148
• fix(sdk): load non-ASCII image paths in qairt VLM on Windows by RemiliaForever (@RemiliaForever) in #1152
• docs: add Simplified Chinese README and sync cn docs by RichardDoong in #1146
• chore(ci): drop dead .apk content-type branch in release.js by RemiliaForever (@RemiliaForever) in #1158
• docs(python): update install instructions to use production PyPI by Mengsheng Wu (@mengshengwu) in #1151
• feat(sdk): support input_ids and get_model_info in qairt plugin by David Qian (@Davidqian123) in #1157
• ci(release): use Trusted Publishing for production PyPI by Perry Cheng (@zhycheng614) in #1156
• feat(sdk): support batched prompts in geniex-bench via --- separator by RemiliaForever (@RemiliaForever) in #1159
• docs(linux): surface host-dependency setup as an install pre-step by Mengsheng Wu (@mengshengwu) in #1167
• feat(qairt): opt-in sliding window CLI flag and env var by David Qian (@Davidqian123) in #1160
• ci(build-sdk): build unsigned HTP skels when signing secret is absent by Mengsheng Wu (@mengshengwu) in #1171
• fix(cli): align serve short aliases with infer/run by RemiliaForever (@RemiliaForever) in #1172
• ci(build-sdk): override cached HTP cert path so unsigned fork builds skip signing by Mengsheng Wu (@mengshengwu) in #1173
• feat(sdk): pull models from Docker Hub's ai/* namespace by Eric Curtin (@ericcurtin) in #1165
• fix(sdk): default to npu and stop clobbering explicit ngl by RemiliaForever (@RemiliaForever) in #1174
• feat(cli): fetch updates from S3 index instead of GitHub releases by RemiliaForever (@RemiliaForever) in #1164
• chore(deps): bump actions/setup-node from 6 to 7 by Dependabot (@dependabot)[bot] in #1176
• fix(sdk): fail cleanly on CPUs missing required armv8.2 features by RemiliaForever (@RemiliaForever) in #1180
• chore(sdk): bump geniex-qairt submodule pointer by David Qian (@Davidqian123) in #1175
• refactor(sdk): remove dead license_key / validation subsystem by Mengsheng Wu (@mengshengwu) in #1184
• chore(sdk): bump llama.cpp to b10019 by RemiliaForever (@RemiliaForever) in #1182
• Remove Mixpanel integration from documentation by AlexCHEN (@alexchen4ai) in #1188
• chore(deps): bump actions/setup-go from 6 to 7 by Dependabot (@dependabot)[bot] in #1189
• docs(docs): expand contributing guide for open-source contributors by Mengsheng Wu (@mengshengwu) in #1177
• docs(cli): sync Chinese README with English CLI docs by Ting Heng Nguan (@HengNguan) in #1192
• fix(ci): bump Windows Hexagon SDK to 6.6.0.0 for parity with Linux/Android by Mengsheng Wu (@mengshengwu) in #1193
• fix(python): exclude resumed bytes from download speed by Mengsheng Wu (@mengshengwu) in #1190
• fix(sdk): fix gemma-4-E2B VLM load and MTP quant selection by RemiliaForever (@RemiliaForever) in #1197
• fix(sdk): enable clip GPU backend when n_gpu_layers is -1 by RemiliaForever (@RemiliaForever) in #1198
• chore(deps): bump pypa/gh-action-pypi-publish from 1.14.0 to 1.14.1 by Dependabot (@dependabot)[bot] in #1200

New Contributors

• RichardDoong made their first contribution in #1146
• Eric Curtin (@ericcurtin) made their first contribution in #1165
• Ting Heng Nguan (@HengNguan) made their first contribution in #1192

Full Changelog: v0.3.14...v0.3.16