Repository navigation
sushi v1.0.2
v1.0.2 — Hotfixes
- Stability: two cached conversations can no longer share a prompt-cache key, a failed long-context cache copy no
longer frees memory twice, and very low temperatures behave the same with and without MTP. - Memory and loading: two resident models no longer over-commit memory at admission, and packs with invalid EXL3
rate stamps are refused by name.