Repository navigation
v0.18.0
- Fix synthesized speech playback in the macOS chat example.
- Add shared
LlamadartEngine<C>lifecycle management and eager text/chat and Decision tasks with events, completion and request-scoped cancellation. - Parse LFM2 tool arguments against their schemas, preserve unescaped inner quotes in required JSON string arguments (#1609), honor explicit parallel requests, keep reasoning non-executable and expose unfinished calls as separate diagnostics.
- Apply supported native/Web lazy tool grammars and Web prompt penalties with explicit capability checks and unchanged ordinary grammar defaults.
- Adopt native LiteRT-LM
v0.19.0and C API 1.0 with legacy compatibility, tagged Android pointer support, validated settings and typed unsupported-path errors. - Preserve LiteRT-LM workers and model caches after unsettled native cleanup; reject incomplete runtime overrides and document process-restart recovery and unsupported text LoRA.
- Keep cached models reusable, visible and removable after cache-root moves, including iOS app updates (#1741).
- Adopt llama.cpp
v0.8.0-3for speculative rollback and model-creation ownership fixes, retaining the genuine nextn query while retiring the unused embedding query; isolate native bundle caches from older apps, verify Apple framework identity and report missing Windows speculative helpers. - Restrict unqualified Android Vulkan Qwen3.5 combinations to bounded ordinary text; refuse larger micro-batches, media, speculation and embeddings (#948).
- Adopt stable-diffusion
v0.3.0-3for original SD checkpoint containers while retaining the SDXS tiny-decoder policy and iOS full-VAE Metal restrictions. - Reinitialize native LiteRT-LM image-chat engines after cancellation before reusing them (#1749).
- Keep future LiteRT-LM SwiftPM pin syncs aligned with macOS app-bundle runtime discovery.
- Request optional Android vendor OpenCL access in the chat example and document LiteRT-LM GPU setup and CPU fallback.
- Document Safari 27 LiteRT-LM Web GPU support, required
require-corpisolation and hidden-tab termination during large model loads (#1025). - Aligned the default WebGPU bridge assets to
v0.1.82with bounded preallocation for large wasm32 model writes. - Pair all three Apple runtime companions at
0.18.0with matching native binaries.
Runtime baseline: native llama.cpp v0.8.0-3 and Web use upstream v0.8.0@8642541b255bfb5dc39cd351a178be09013a55d6; native LiteRT-LM uses v0.19.0 and stable-diffusion uses v0.3.0-3. Web LiteRT-LM stays @litert-lm/core@0.18.0. Manifest SHA-256: fda19e047aba5a511020854437cc89e2f53e2f67f5f6cf5fec336faef3a6c362.
Known issue
- On ARM64 (macOS and the optimized Linux CPU modules), F16 dot products in native
v0.8.0-3can overflow toinfon large-magnitude inputs (llamadart-native#174). This is not a regression, and no public-model failure has been observed. A fix will ship in a later native release (llamadart-native#177).