Skip to content

v0.16.3

Choose a tag to compare

@github-actions github-actions released this 26 Oct 10:11
· 109 commits to main since this release
98d47a3
  • Recommend the corrected Qwen3-0.6B LiteRT-LM model bundle for native CPU to preserve split-token emoji; replace the older model artifact rather than relying on a runtime upgrade.
  • Inspect desktop setup with collectLlamaRuntimeSetupReport() and dart run llamadart:doctor [--json]. Reports separate pinned publication policy from unchecked native loading, GPU/backend selection and model behavior. Exit 0 means report generation, not runtime validation (#124).
  • Set reproducible dates in Dart-rendered chat templates with TemplateTimeChatSession and explicit clocks for strftime_now (#859).
  • Rerank documents with LlamaReranker on native rank-pooled GGUF models, preserving classifier scores, labels and document indices (#323).
  • Generate repeating textures with independent X/Y axes through SeamlessImageGenerationRequest; the initial SDXS embedded-tiny-decoder recipe is qualified at 512×512 on CPU and Metal (#1234).
  • Add opt-in spatial VAE tiling with TiledImageGenerationRequest and ImageVaeTiling, qualified on SD-Turbo full VAE/TAESD with macOS CPU and Metal. Decoder buffers are about one quarter of untiled size, with longer decoding; other SD 2.x checkpoints remain unmeasured, and unsupported families, backends and circular-axis combinations are refused (#1231).
  • Control retained image prompt conditioning with ImageConditioningCacheParams; zero disables reuse, while ordinary settings preserve the runtime default.
  • Add opt-in EmbeddingGemma-2 query/document/title helpers and normalized 768/512/256/128-dimensional outputs. Existing raw embedding calls are unchanged (#1126).
  • Fix explicit Web GGUF GPU placement with splitMode: ModelSplitMode.none and negative mainGpu; unavailable or inactive GPUs still throw (#915).
  • Cancel queued Web generation, speech-to-text or speech-synthesis tasks without stopping another request running on the bridge (#1371).
  • Keep the default WebGPU bridge assets at v0.1.73 (unchanged from 0.16.2).

Web runtime baseline (unchanged): upstream llama.cpp v0.7.0@620d2225cc436ab0b001e3200e590e3b286ef9ab, native v0.7.0-2; Web LiteRT-LM @litert-lm/core@0.18.0. Bridge manifest SHA-256: f89c41d151b7df0cbe4f5e97f95563e31e0968c13e65a630e4e0dba28adb1d44.