Repository navigation
v0.12.2
-
Pair this release with Apple companions
llamadart_llama_cpp_flutter
0.0.23,llamadart_litert_lm_flutter0.0.16and
llamadart_stable_diffusion_flutter0.0.3, which link native runtimes
v0.6.0-3,v0.18.0-1andv0.2.0-3, respectively. -
The default llama.cpp runtime is now
leehack/llamadart-native@v0.6.0-3,
whose Apple frameworks declare their minimum OS version (iOS 16.4, macOS
13.3) (#1037). -
Flutter iOS and macOS apps that keep
llamadart_llama_cpp_flutter0.0.22
(nativev0.6.0-2, the same binaries) still build, with a warning to depend
on^0.0.23for the frameworks' minimum OS version metadata. Any other
mismatched companion still fails the build, and the error names the
companion version to depend on
(#1063). -
The default LiteRT-LM runtime is now
leehack/litert-lm-native@v0.18.0-1,
whose macOS runtimes are arm64 only. Universal Flutter macOS apps with
llamadart_litert_lm_flutternow launch on Intel Macs and under Rosetta
instead of aborting; LiteRT-LM throwsLlamaUnsupportedExceptionon x86_64
macOS (litert-lm-native#72). -
The build hook verifies every llama.cpp archive it downloads or reuses from
its cache against a pinned SHA-256, or the release'sSHA256SUMSwhen
llamadart_native_tagorllamadart_native_repositoryoverrides the
release. A mismatched cached archive is downloaded again; a fresh download
that does not match fails the build withNativeArchiveDigestException
(#1015). -
A
.litertlmbundle in a directory the process cannot write, such as an
iOS app bundle, no longer fails GPU engine creation on iOS and Linux when
liteRtLmCacheDiris unset: the GPU engine reuses caches already there or
runs without them (#976). -
Image generation on Metal:
ImageModelParams.vaeDirectConvolution: true
throwsLlamaUnsupportedExceptionat load on iOS instead of returning
corrupt images (#1044),
and after a failed command buffer generation says the model must be
reloaded and fails later generations on that engine with the same message
(#1045). -
A model cache directory that cannot be created, such as an unwritable
ModelLoadOptions.cacheDirectory, throwsLlamaModelExceptionnaming the
directory instead of a rawFileSystemException
(#894). A download that
fails TLS certificate verification says so in itsLlamaModelException,
and TLS certificate and handshake failures are no longer retried
(#978). -
A
ModelResolverthat maps a remote source to a local mirror file now
loads it when the download options setcacheDirectory, credentials or
other download-only options, instead of throwing
LlamaUnsupportedException
(#897). -
ModelParams.loraswith more than one adapter or a scale other than 1.0
throwsLlamaUnsupportedExceptionbefore any adapter downloads when the
model loads in LiteRT-LM, by backend, format or.litertlmextension
(#891). -
The chat example no longer sends its stored Min-P to text to speech when
the loaded runtime does not support Min-P
(#747).
- Aligned the default WebGPU bridge assets to
v0.1.59, unchanged from 0.12.1:
they embed llama.cppv0.6.0, are qualified against nativev0.6.0, and
keep Web/native llama.cppv0.6.0@d81235049384534c167caea52b85a694f6103d14
parity; Web LiteRT-LM is@litert-lm/core@0.18.0. Immutable Web asset
manifest:
f823b10417b212ff1f66aa1c46bf78af7d9c393497dfcf0fa3a4f77adeb260eb.