Repository navigation
v0.9.9
Faster across the board, and steadier.
- Models stay loaded while they fit. A follow-up question loads nothing, and going back to an expert that is still in memory is instant. Five routed prompts from a cold start took 160 s, down from 428.
- Cold loads are about twice as fast: Qwen3.8-27B in 35 s instead of 73, flint in 40 instead of 78. On Linux the fastest card fills first.
- The Bench asks many questions at once. The small LFM2.5 model's Quick run takes under 3 minutes instead of 13.
- Fine-tuning is three to four times faster, and every fine-tune now ends at a GGUF. Before, on a machine with a downloaded runtime, it ended at a folder Crucible could not load. New recipes learn at 1e-4.
- Long conversations open at once, replies stream without the window falling behind, and typing keeps up beside a long chat.
- The delegator on a Mac: MLX models are listed, and Get one fetches a small GGUF delegator when the folder has none.
- Steadier: a killed orchestrator, a model with no vocabulary, a Gemma picture with a large Batch and a conversation full of pictures no longer crash or stall, and crash.log says why llama.cpp stopped.
Everything else is in the CHANGELOG.