Skip to content

Agent Cache v0.11.0

Choose a tag to compare

@KIvanow KIvanow released this 07 Jul 16:04
aa790ab

Streaming responses are now cached. The Vercel AI SDK adapter implements wrapStream alongside wrapGenerate, so streamText calls hit the cache too - on a miss the streamed text is accumulated and stored on finish; on a hit it's replayed instantly (marked providerMetadata.agentCache.hit). Tool-call streams are left uncached, store happens asynchronously so it never blocks the caller-facing stream, and upstream errors pass through untouched. No breaking changes; requires ai ^6.0.135.

npm install @betterdb/agent-cache@0.11.0

What's Changed

  • feat(retrieval): LongMemEval lever ablation foundation by @jamby77 in #284
  • feat(retrieval): structured context assembly (Issue 1) by @jamby77 in #285
  • feat(retrieval): query-time temporal resolver (Issue 2, slim) by @jamby77 in #287
  • fix(mcp): pass section param through to info endpoint by @AruneshDwivedi in #280
  • fix(mcp): report package version from metadata by @RitwijParmar in #222
  • feat(agent-cache/ai): cache streaming LLM responses via wrapStream by @amitkojha05 in #262
  • chore(agent-cache): release v0.11.0 (streaming cache) + fix TS build by @KIvanow in #306

New Contributors

Full Changelog: agent-cache-v0.10.0...agent-cache-v0.11.0