Skip to content

xInfer v0.13.8

Choose a tag to compare

View all tags
@github-actions github-actions released this 10 Jul 08:18
· 38 commits to main since this release
v0.13.8
487ab42
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • Fix resource release & batching for gdn models by @guoqingbao in #423
  • E4M3 clamp fix for nvfp4 input quant by @guoqingbao in #425
  • Fix correctness issues in scheduler, prefix cache, and error handling by @guoqingbao in #405
  • Improve kvcache and gdn state release logics by @guoqingbao in #426
  • CPU offloading for kvcache and mamaba states under prefix-cache by @guoqingbao in #428

Full Changelog: v0.13.7...v0.13.8

Contributors

guoqingbao
Assets 29
Loading