Skip to content

v1.6.4 - Critical Performance Fix

Choose a tag to compare

@jwesleye jwesleye released this 31 Dec 16:02
· 95 commits to main since this release

v1.6.4 - Critical Performance Fix

This patch release fixes a critical performance bug introduced in v1.6.2 that caused session summaries to be generated after every single turn.

Bug Fixed

  • Session summary generation on every turn: Fixed regression where the agent was generating AI summaries after each user query
    • Root cause: After v1.6.2 refactoring, save_conversation() always called _generate_session_summary()
    • Impact: Wasteful API calls, slower response times, confusing summary output in normal conversation
    • Fix: Added generate_summary parameter (default False) to save_conversation()

When Summaries Are Generated

Session summaries are now only generated when explicitly needed:

  • ✅ On session compaction (#compact command)
  • ✅ On final save when exiting the chat
  • ❌ NOT after every query-response turn (fixed!)

Performance Improvements

  • Eliminates unnecessary API calls for summary generation
  • Faster response times (no summary generation delay after each turn)
  • Cleaner conversation flow without spurious summaries

Testing

  • All 318 tests passing
  • Clean linting and type checking

Recommendation

Users experiencing slow responses or seeing summaries after every turn should upgrade immediately:

pip install --upgrade basic-agent-chat-loop

This release maintains full backward compatibility.