v2.3.0 - Batch Consolidation & Token Efficiency

Large memory sets are now split into smaller LLM prompts via chunk-based processing, with optimizations to minimize token costs across multi-chunk passes.

New

• Chunk-based consolidation: ChunkPlanner partitions memory files respecting maxPromptChars and maxFilesPerBatch limits
• ChunkMerger with last-chunk-wins strategy and order preservation
• Prompt caching support for Bedrock (Anthropic cachePoint) and OpenAI (system/user message split)
• Pre-computed shared context eliminates redundant filesystem reads per chunk
• Config: max_prompt_chars (default 120K) and max_files_per_batch (default 30)

Changed

• Default maxPromptChars raised from 60K to 120K
• LlmBackend.consolidate() accepts optional ConsolidateOptions with systemPrompt
• ConsolidationResult now includes chunksTotal and chunksCompleted

Testing

• 231 tests across 21 files, including 10 property-based tests