Skip to content

v0.18.0

Choose a tag to compare

@github-actions github-actions released this 07 Nov 11:36
· 174 commits to main since this release
fa8a222
  • Fix synthesized speech playback in the macOS chat example.
  • Add shared LlamadartEngine<C> lifecycle management and eager text/chat and Decision tasks with events, completion and request-scoped cancellation.
  • Parse LFM2 tool arguments against their schemas, preserve unescaped inner quotes in required JSON string arguments (#1609), honor explicit parallel requests, keep reasoning non-executable and expose unfinished calls as separate diagnostics.
  • Apply supported native/Web lazy tool grammars and Web prompt penalties with explicit capability checks and unchanged ordinary grammar defaults.
  • Adopt native LiteRT-LM v0.19.0 and C API 1.0 with legacy compatibility, tagged Android pointer support, validated settings and typed unsupported-path errors.
  • Preserve LiteRT-LM workers and model caches after unsettled native cleanup; reject incomplete runtime overrides and document process-restart recovery and unsupported text LoRA.
  • Keep cached models reusable, visible and removable after cache-root moves, including iOS app updates (#1741).
  • Adopt llama.cpp v0.8.0-3 for speculative rollback and model-creation ownership fixes, retaining the genuine nextn query while retiring the unused embedding query; isolate native bundle caches from older apps, verify Apple framework identity and report missing Windows speculative helpers.
  • Restrict unqualified Android Vulkan Qwen3.5 combinations to bounded ordinary text; refuse larger micro-batches, media, speculation and embeddings (#948).
  • Adopt stable-diffusion v0.3.0-3 for original SD checkpoint containers while retaining the SDXS tiny-decoder policy and iOS full-VAE Metal restrictions.
  • Reinitialize native LiteRT-LM image-chat engines after cancellation before reusing them (#1749).
  • Keep future LiteRT-LM SwiftPM pin syncs aligned with macOS app-bundle runtime discovery.
  • Request optional Android vendor OpenCL access in the chat example and document LiteRT-LM GPU setup and CPU fallback.
  • Document Safari 27 LiteRT-LM Web GPU support, required require-corp isolation and hidden-tab termination during large model loads (#1025).
  • Aligned the default WebGPU bridge assets to v0.1.82 with bounded preallocation for large wasm32 model writes.
  • Pair all three Apple runtime companions at 0.18.0 with matching native binaries.

Runtime baseline: native llama.cpp v0.8.0-3 and Web use upstream v0.8.0@8642541b255bfb5dc39cd351a178be09013a55d6; native LiteRT-LM uses v0.19.0 and stable-diffusion uses v0.3.0-3. Web LiteRT-LM stays @litert-lm/core@0.18.0. Manifest SHA-256: fda19e047aba5a511020854437cc89e2f53e2f67f5f6cf5fec336faef3a6c362.

Known issue

  • On ARM64 (macOS and the optimized Linux CPU modules), F16 dot products in native v0.8.0-3 can overflow to inf on large-magnitude inputs (llamadart-native#174). This is not a regression, and no public-model failure has been observed. A fix will ship in a later native release (llamadart-native#177).