Agent Cache v0.11.0
Streaming responses are now cached. The Vercel AI SDK adapter implements wrapStream alongside wrapGenerate, so streamText calls hit the cache too - on a miss the streamed text is accumulated and stored on finish; on a hit it's replayed instantly (marked providerMetadata.agentCache.hit). Tool-call streams are left uncached, store happens asynchronously so it never blocks the caller-facing stream, and upstream errors pass through untouched. No breaking changes; requires ai ^6.0.135.
npm install @betterdb/agent-cache@0.11.0
What's Changed
- feat(retrieval): LongMemEval lever ablation foundation by @jamby77 in #284
- feat(retrieval): structured context assembly (Issue 1) by @jamby77 in #285
- feat(retrieval): query-time temporal resolver (Issue 2, slim) by @jamby77 in #287
- fix(mcp): pass section param through to info endpoint by @AruneshDwivedi in #280
- fix(mcp): report package version from metadata by @RitwijParmar in #222
- feat(agent-cache/ai): cache streaming LLM responses via wrapStream by @amitkojha05 in #262
- chore(agent-cache): release v0.11.0 (streaming cache) + fix TS build by @KIvanow in #306
New Contributors
- @AruneshDwivedi made their first contribution in #280
- @RitwijParmar made their first contribution in #222
Full Changelog: agent-cache-v0.10.0...agent-cache-v0.11.0