New Features:
-
Compact Chat Memory
• Added rolling conversation summary with the last two user/assistant exchanges.
• Older raw messages are removed to prevent context growth.
• Conversation memory is configurable throughMAIN_HISTORY_MESSAGES_TO_KEEP. -
Execution Logging
• Added optional terminal logs for graph steps, routing decisions, tool calls, and outputs.
• Added colored and truncated state previews for easier debugging.
• Logging can be enabled from the project configuration. -
Updated Model Defaults
• Switched the default main LLM togranite4.1:8b.
• Added deterministic generation withLLM_SEED = 42.
• Updated the local judge model toministral-3:3b-instruct-2512-q8_0.
Bug Fixes:
-
Prompt and Source Handling
• Refined system prompts to reduce invented sources and generic answer headings.
• Standardized source formatting across generator, fallback, and aggregation prompts.
• Improved query rewriting for standalone terms, acronyms, and follow-up questions. -
Retrieval and Chunking Cleanup
• Restored the forced first retrieval call for local tool-calling reliability.
• Changed parent chunk IDs from<document>_parent_Nto<document>_pN. -
Evaluation and Documentation Alignment
• Improved the curated RAGAS QA dataset with balanced questions per document.
• Updated evaluation to use a fresh chat thread for each query.
• Synced prompts, README files, notebooks, Dockerfile, and project configuration.