Skip to content

Fix crash in kv cache CPU offloading logic

Latest
Latest

Choose a tag to compare

View all tags
@sriumcp sriumcp released this 06 Feb 00:50
· 1 commit to main since this release
v0.6.6
fc9d89f
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • [Bugfix] Fix IndexError during chunked prefill with CPU KV offloading by @sriumcp in #47

Full Changelog: v0.6.5...v0.6.6

Contributors

sriumcp
Assets 2
Loading