Skip to content

v0.8.0

Latest

Choose a tag to compare

@github-actions github-actions released this 19 Jul 12:10

What's Changed

  • feat(kv-cache): bound the cold (SSD) tier and wire its budgets by @magicnight in #98
  • feat(kv-cache): fingerprint cold entries against model weight identity by @magicnight in #99
  • feat(kv-cache): persist a cold index so prefix reuse survives a restart by @magicnight in #100
  • perf(kv-cache): move cold-tier writes off the store actor's executor by @magicnight in #101

Full Changelog: v0.7.0...v0.8.0