Skip to content

sushi v1.0.2

Choose a tag to compare

@github-actions github-actions released this 25 Sep 10:18
· 652 commits to main since this release

v1.0.2 — Hotfixes

  • Stability: two cached conversations can no longer share a prompt-cache key, a failed long-context cache copy no
    longer frees memory twice, and very low temperatures behave the same with and without MTP.
  • Memory and loading: two resident models no longer over-commit memory at admission, and packs with invalid EXL3
    rate stamps are refused by name.