Repository navigation
v0.16.3
- Recommend the corrected Qwen3-0.6B LiteRT-LM model bundle for native CPU to preserve split-token emoji; replace the older model artifact rather than relying on a runtime upgrade.
- Inspect desktop setup with
collectLlamaRuntimeSetupReport()anddart run llamadart:doctor [--json]. Reports separate pinned publication policy from unchecked native loading, GPU/backend selection and model behavior. Exit 0 means report generation, not runtime validation (#124). - Set reproducible dates in Dart-rendered chat templates with
TemplateTimeChatSessionand explicit clocks forstrftime_now(#859). - Rerank documents with
LlamaRerankeron native rank-pooled GGUF models, preserving classifier scores, labels and document indices (#323). - Generate repeating textures with independent X/Y axes through
SeamlessImageGenerationRequest; the initial SDXS embedded-tiny-decoder recipe is qualified at 512×512 on CPU and Metal (#1234). - Add opt-in spatial VAE tiling with
TiledImageGenerationRequestandImageVaeTiling, qualified on SD-Turbo full VAE/TAESD with macOS CPU and Metal. Decoder buffers are about one quarter of untiled size, with longer decoding; other SD 2.x checkpoints remain unmeasured, and unsupported families, backends and circular-axis combinations are refused (#1231). - Control retained image prompt conditioning with
ImageConditioningCacheParams; zero disables reuse, while ordinary settings preserve the runtime default. - Add opt-in EmbeddingGemma-2 query/document/title helpers and normalized 768/512/256/128-dimensional outputs. Existing raw embedding calls are unchanged (#1126).
- Fix explicit Web GGUF GPU placement with
splitMode: ModelSplitMode.noneand negativemainGpu; unavailable or inactive GPUs still throw (#915). - Cancel queued Web generation, speech-to-text or speech-synthesis tasks without stopping another request running on the bridge (#1371).
- Keep the default WebGPU bridge assets at
v0.1.73(unchanged from 0.16.2).
Web runtime baseline (unchanged): upstream llama.cpp v0.7.0@620d2225cc436ab0b001e3200e590e3b286ef9ab, native v0.7.0-2; Web LiteRT-LM @litert-lm/core@0.18.0. Bridge manifest SHA-256: f89c41d151b7df0cbe4f5e97f95563e31e0968c13e65a630e4e0dba28adb1d44.