Skip to content

v0.15.0

Latest

Choose a tag to compare

@dbcp1 dbcp1 released this 04 Aug 00:17

🍎 Apple Foundation Framework

  • Apple FM Adapter: Shipped a new Apple Foundation framework adapter natively integrating Apple's backend with the LiteRT-LM runtime for fast text and multimodal (vision/audio) execution featuring Gemma4 models, thanks to john-rocky's contributions!
  • Concurrency & Stability: Resolved re-entrancy issues on concurrent engine initializations.

🛠️ LiteRT-LM CLI

  • Centralized config.json System: Introduced configuration file support for the LiteRT-LM CLI to define global defaults and per-model settings (such as specialized hardware backends, thinking budgets, and context window sizes) without needing to pass verbose command-line flags.
  • Strict Parameter Precedence: Execution parameters follow a clear hierarchy: Runtime arguments > Model-specific config > Global defaults > Model metadata > Engine fallbacks. For more details, see the CLI Configuration guide.

🌐 JavaScript API & Web Application (LiteRT-LM.js)

  • Gemma 4 Web Support: Gemma 4 12B, Gemma 4 26B A4B, and Gemma 4 31B are officially supported on web.
  • Memory Efficiency: Added a new use_autosized_ringbuffers option that improves long context memory efficiency.
  • Tool Calling Capabilities: Added AutoToolChat, which automatically runs tool calls that the model emits.