Skip to content

v0.4.5

Choose a tag to compare

View all tags
@asher asher released this 29 Aug 20:49
· 44 commits to main since this release
Immutable release. Only release title and notes can be modified.
v0.4.5
6807f3d
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • fix(glm5-next): zero-width V scatter chain exhausts Metal buffer-count limit during decode by @asher in #91
  • fix(stream): erase residency on feeder close and serve eviction by @asher in #92
  • feat(serve): detect a stale server post-upgrade and recommend restart by @asher in #93
  • feat(lora): serve many adapters live on one resident GGUF base by @asher in #94
  • fix(mtp): thinking_budget now works in combination with speculative decoding by @asher in #95
  • fix(qsa): QSAKVCache APC contract across exact/block/ckpt/disk tiers, MTP tail-absorb, integer shard dtypes by @asher in #96

Full Changelog: v0.4.4...v0.4.5

Contributors

asher
Assets 3
Loading