Skip to content

1.7.1

Choose a tag to compare

@andriydruk andriydruk released this 06 Jun 10:48

What's New

Models

  • Gemma 4 12B (Google) and Granite 4.1 3B & 8B (IBM) added to the model catalog.

Performance & Stability

  • Larger models load on more devices — a model that doesn't fully fit in RAM now loads memory-mapped instead of failing to start.
  • Updated inference engine to llama.cpp b9496 for the latest model and chat-template support.