Skip to content

v0.40.0 — context compaction for long chat/code sessions (#48)

Choose a tag to compare

View all tags
@gobha-me gobha-me released this 21 Jul 12:17
v0.40.0
bd6299a

Adds context-window compaction so long venice chat/venice code sessions stay in-context instead of dying on an over-long prompt.

  • /compact [N] — manual REPL command: summarize the older prefix into one synthetic system message, keeping the last N turns verbatim.
  • --auto-compact (+ --compact-threshold, --compact-keep-turns) on both chat and code, config-backable via defaults.<cmd>.*. Fires once the prompt crosses the token budget (server usage.prompt_tokens when available, char estimate otherwise).
  • Best-effort and non-destructive: a failed/empty summary leaves history untouched; never orphans a tool result from its assistant turn.

Closes #48.

Assets 2
Loading