Skip to content

v0.9.9

Choose a tag to compare

@github-actions github-actions released this 07 Nov 03:09
· 9 commits to main since this release

Faster across the board, and steadier.

  • Models stay loaded while they fit. A follow-up question loads nothing, and going back to an expert that is still in memory is instant. Five routed prompts from a cold start took 160 s, down from 428.
  • Cold loads are about twice as fast: Qwen3.8-27B in 35 s instead of 73, flint in 40 instead of 78. On Linux the fastest card fills first.
  • The Bench asks many questions at once. The small LFM2.5 model's Quick run takes under 3 minutes instead of 13.
  • Fine-tuning is three to four times faster, and every fine-tune now ends at a GGUF. Before, on a machine with a downloaded runtime, it ended at a folder Crucible could not load. New recipes learn at 1e-4.
  • Long conversations open at once, replies stream without the window falling behind, and typing keeps up beside a long chat.
  • The delegator on a Mac: MLX models are listed, and Get one fetches a small GGUF delegator when the folder has none.
  • Steadier: a killed orchestrator, a model with no vocabulary, a Gemma picture with a large Batch and a conversation full of pictures no longer crash or stall, and crash.log says why llama.cpp stopped.

Everything else is in the CHANGELOG.