Release 2026.9.1 · sockless-coding/llm-router

What's Changed

Per-server concurrency limiting — The router now caps concurrent requests to each llama.cpp server at its actual slot count. Requests queue when all candidate servers are saturated.
Live slot usage and expanded telemetry — Added llama.cpp /props telemetry, including slots, context size, vision/audio support, model path, and build information. Server detail pages and the dashboard now show live slot usage.
Configurable default parallel slots — Added GatewaySettings.DefaultParallelSlots, defaulting to 4 when server capacity and preset settings are unavailable.

Tool-call streaming — Fixed malformed tool calls during speculative/MTP decoding by buffering nameless tool-call fragments and emitting the correct OpenAI wire format.
Ollama vision detection — Models configured with an mmproj path or URL are now correctly reported as vision-capable.
Ollama context reporting — /api/tags and /api/show now report the preset's configured context size, falling back to the model's native GGUF value when unset.
GPU registry handling — Unreadable GPU driver registry subkeys no longer crash the Devices page; inaccessible entries are skipped gracefully.

Full Changelog: 2026.9.0...2026.9.1