You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Apple FM Adapter: Shipped a new Apple Foundation framework adapter natively integrating Apple's backend with the LiteRT-LM runtime for fast text and multimodal (vision/audio) execution featuring Gemma4 models, thanks to john-rocky's contributions!
Concurrency & Stability: Resolved re-entrancy issues on concurrent engine initializations.
🛠️ LiteRT-LM CLI
Centralized config.json System: Introduced configuration file support for the LiteRT-LM CLI to define global defaults and per-model settings (such as specialized hardware backends, thinking budgets, and context window sizes) without needing to pass verbose command-line flags.
Strict Parameter Precedence: Execution parameters follow a clear hierarchy: Runtime arguments > Model-specific config > Global defaults > Model metadata > Engine fallbacks. For more details, see the CLI Configuration guide.