Repository navigation
2026.9.3
New Features
- Massively expanded llama.cpp presets — ~70 new server flags added to presets, including endpoint toggles, model alias/tags, video input, LoRA init-without-apply, CORS/SSL settings, and logging options. The preset form now uses a tabbed layout with a live generated CLI-args preview.
- Draft models & mmproj projector links — Presets can link
SpecDraftModelIdandMmprojIdto registry entries, so draft models and multimodal projectors can be picked from the model library and stay in sync withLocalModel.FilePath, mirroring the main model link. - Models grouped by repo — The Models index now collapses multiple quants and auxiliary files of the same model into a single expandable group row with aggregate status, size, and preset-usage totals. GGUF files are classified as primary models vs. mmproj projectors, with projectors shown as "extra" files under their group.
- Quick-add links on the Models page —
- "+ Version" on Hugging Face groups jumps straight to that repo's file list (
?repoId=) instead of requiring a search. - "+ File" scopes the create-page
.ggufcandidate scan to the model's own folder (?folder=). - "Model Card" link to the HF repo, plus "View on Hugging Face" on the model details page.
- "+ Version" on Hugging Face groups jumps straight to that repo's file list (
- In-place model updates — Hugging Face models can be re-downloaded over their existing path, updating the same registry row so presets referencing the model keep working. The models page has an "update" action with a confirmation prompt (warns when presets use the model).
Fixes
- Forced non-streaming responses in queued handler — The non-streaming request path now explicitly sets
stream=false, so queued payloads built for streaming requests are no longer answered with SSE framing that can't be parsed as a single JSON document. - Preset update integrity — Hand-maintained field copies in
PresetManager.UpdateAsyncwere replaced withCurrentValues.SetValuesso newly added fields can't be silently dropped on update. - Culture-independent decimal binding — Invariant culture is now forced on all threads so decimal preset fields bind correctly on machines using a comma decimal separator.
Full Changelog: 2026.9.2...2026.9.3