1.7.1
What's New
Models
- Gemma 4 12B (Google) and Granite 4.1 3B & 8B (IBM) added to the model catalog.
Performance & Stability
- Larger models load on more devices — a model that doesn't fully fit in RAM now loads memory-mapped instead of failing to start.
- Updated inference engine to llama.cpp b9496 for the latest model and chat-template support.