Skip to content

Enhanced KV event stream for modeling

Choose a tag to compare

View all tags
@sriumcp sriumcp released this 04 Feb 12:56
· 10 commits to main since this release
v0.5.0
76fd127
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • [Feature] Add KV cache offloading tracing event types (Phase 1) by @sriumcp in #36
  • [Feature] Add KV cache offloading local transfer events (Phase 2) by @sriumcp in #37
  • [Feature] Add KV cache remote transfer events (Phase 3) by @sriumcp in #38
  • [Feature] Production-ready KV events subscriber (Phase 4) by @sriumcp in #39

Full Changelog: v0.4.6...v0.5.0

Contributors

sriumcp
Assets 2
Loading