Skip to content

v0.7.3 — Context Compaction & API Resilience

Choose a tag to compare

@acodercat acodercat released this 08 Apr 10:24
· 32 commits to master since this release
38c4925

What's New

  • Context Compaction — 3-tier strategy inspired by Claude Code: microcompact (clear old execution
    results) → LLM summarization (dual-phase analysis+summary prompt) → trim fallback, with circuit breaker
    protection. Replaces naive max_history truncation with token-aware context_window management.
  • API Resilience — Exponential backoff retry for 429/5xx/timeout errors (up to 5 attempts). Automatic
    output truncation recovery when finish_reason="length" (up to 3 continuations).

Improvements

  • Extract types.py — Message and Event types moved to dedicated module, eliminating circular imports
  • Extract shared Model methods (_extract_response, _process_stream_chunk) to base class
  • Code syntax highlighting in terminal display (Rich Syntax, one-dark theme)
  • finish_reason tracking on ModelResponse and StreamResponse