Repository navigation
v0.13.0
-
Pair this release with Apple companions
llamadart_llama_cpp_flutter,
llamadart_litert_lm_flutterandllamadart_stable_diffusion_flutter
0.13.0, which link native runtimesv0.6.0-3,v0.18.0-1andv0.2.0-3,
respectively. -
Behavior change: Apple companion versions now share the core
MAJOR.MINOR, starting at0.13.0, with independent patch versions. Each
companion depends onllamadartwithin its core minor
('>=0.13.0 <0.14.0'), so pub refuses a mismatched companion and core
instead of the iOS or macOS build failing, and the Apple build error or
warning for a mismatched or older llama.cpp companion names that minor,
such as^0.13.0. Apps that takellamadartfrom a path or git checkout
add it underdependency_overrides
(#857). -
Behavior change: LiteRT-LM caps each cache directory's GPU program cache
files at 1 GiB by default
(ModelParams.defaultLiteRtLmMaxProgramCacheBytes), pruning least recently
modified files first before each engine create, so an existing oversized
cache is pruned on the first create after upgrading. An explicit
liteRtLmMaxProgramCacheBytesnow bounds the directory total instead of
each file; passModelParams.unlimitedLiteRtLmProgramCacheBytes(-1) to
keep every file. Engines sharing a cache directory no longer delete the
program caches of a model another one is running, and
liteRtLmCacheDir: ':nocache'no longer creates a directory, which failed
the load on Windows (#552). -
Add
ToolDefinition.fromJsonSchemafor owned, validated tool input schemas,
with explicit errors for unsupported constraints, formats and runtimes
(#1007). -
Behavior change:
ToolParamtool grammars are stricter: GLM-4.5, Laguna
and Hunyuan V3 integer parameters reject fractions,ToolParam.nullType
accepts onlynull, and Gemma 2/3 multi-tool grammars require the
{"tool_call": ...}wrapper. Open JSON Schema objects, including
responseFormatschemas, no longer accept a declared property through the
extra-property slot unless the declared names exceed the grammar size budget. -
Behavior change: a
ToolChoice.requiredreply cut short by a cancel or
maxTokensends withstoporlengthand no tool calls instead of
throwingStateError; other output a PEG parser cannot parse, including in
ChatTemplateEngine.parse, throwsLlamaInferenceException
(#890). -
Behavior change: on native llama.cpp, a runtime missing an mtmd function,
with no complete fallback mtmd library, fails image and audio requests, and
supportsVision, withLlamaUnsupportedExceptionnaming the function and
pinned runtime
(#640). -
Behavior change: on Web,
SpeechToTextEngine.load,
TextToSpeechEngine.loadandLlamaEngine.setModelwith a projector report
progress from 0 to 1, asDecisionEngine.loaddoes
(#903). -
On macOS x86_64, LiteRT-LM GPU requests fail up front with
LlamaUnsupportedException, and LiteRT-LM is no longer reported or selected
as GPU there (#711). -
With
llamadart_litert_lm_flutter0.0.15, the macOS build only warns to
upgrade the companion instead of claiming the app needs the LiteRT-LM build
phase (#1064). -
WebGpuLlamaBackend(bridgeScriptUrl: ...)loads the bridge in dart2js
builds (#735). -
The image model memory check treats a GPU reporting 0 bytes free, as Vulkan
does over budget, as having no free GPU memory: loads warn and, on Linux,
are refused above system memory
(#980). -
LlamaEngine.getPerformanceContext()returns null after a generation
cancelled before it reached the backend, instead of the previous request's
counters (#677). -
Clearer errors: a chat template that fails to render names its source
(#820), a
SpeechToTextEngineattached to a disposedLlamaEnginereports the
disposal (#924), and an
ImageGenerationEngine.loadSHA-256 mismatch names the main file by
position, not its path or URL
(#907).
- Aligned the default WebGPU bridge assets to
v0.1.59, unchanged from 0.12.2:
they embed llama.cppv0.6.0, are qualified against nativev0.6.0, and
keep Web/native llama.cppv0.6.0@d81235049384534c167caea52b85a694f6103d14
parity; Web LiteRT-LM is@litert-lm/core@0.18.0. Immutable Web asset
manifest:
f823b10417b212ff1f66aa1c46bf78af7d9c393497dfcf0fa3a4f77adeb260eb.