Skip to content

v0.19.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 08 Nov 19:45
· 145 commits to main since this release
v0.19.0
0baad71
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  • Add native llama.cpp speech output for LFM3-Audio, Soprano, Chatterbox Turbo, Chatterbox Multilingual and Pocket TTS (Lfm3AudioTtsAdapter, SopranoTtsAdapter, ChatterboxTtsAdapter, PocketTtsAdapter), with predefined voice selection (TextToSpeechRequest.voice, TextToSpeechCapabilities.voices) and Chatterbox and Pocket speaker-reference cloning. LFM3-Audio and Soprano need llamadart-native v0.8.0 and Chatterbox and Pocket v0.9.0; older runtimes refuse them with LlamaUnsupportedException (#1615, #1783).
  • Adopt native llama.cpp v0.9.0: ARM64 CPU F16 dot products of large values no longer overflow to inf or NaN (llamadart-native#174), and Qwen3-TTS sampling applies the GGUF's suppress tokens.
  • Aligned the default WebGPU bridge assets to v0.1.83 on the same upstream llama.cpp as native, so Web Qwen3-TTS also applies the GGUF's suppress tokens (llama-web-bridge#211).
  • Adopt native LiteRT-LM v0.19.1-1 (upstream LiteRT-LM v0.19.1); the C API is unchanged.
  • Support LiteRT-LM native CPU embeddings on Linux x64, Linux arm64 and Windows x64 (#1367), and fix the crash at the first LiteRT-LM GPU decode on Linux x64 and Windows x64 (#1795).
  • Fix LiteRT-LM text-only or audio-only turns that failed with "Image history requires a vision encoder." after an image turn on the same engine (#1781).
  • Move Web LiteRT-LM to @litert-lm/core@0.19.0; WebGPU loads keep the runtime's default backend, so standard .litertlm bundles load there. Web embeddings, tool loops, media and custom templates stay unsupported. In Safari 27, GPU text, history and the chat app pass; on CPU, the runtime's compat build can leave Qwen3 0.6B thinking through its whole token budget (#1025, #1802).
  • Support microBatchSize above 8, media (with the image encoder on the CPU), speculation and embeddings for native Qwen3.5 on Android Vulkan with the bundled runtime; runtimes older than ggml 0.28.0 (llamadart-native v0.8.0) keep the text-only restriction (#948).
  • Pair all three Apple runtime companions at 0.19.0 with matching native binaries.

Runtime baseline: native llama.cpp v0.9.0 and Web use upstream v0.9.0@cd959bae99ff4bed22bef2604f45241c09bbb8c8; native LiteRT-LM uses v0.19.1-1 and stable-diffusion uses v0.3.0-3. Web LiteRT-LM uses @litert-lm/core@0.19.0. Manifest SHA-256: ae6f488408672f9ba28d8f9e664a2b85f4e12048f290e259e18dd0b750c038e5.

Assets 2
Loading