Skip to content

v0.17.0

Choose a tag to compare

@daltonnyx daltonnyx released this 18 Jun 16:41

Release v0.17.0

🚀 Features

  • Vision Preprocessing for Non-Vision Models
    Introduced VisionPreprocessingUtils and VisionDescriptionCache to automatically replace image content with text descriptions generated by an associated vision model when the primary model lacks vision capabilities.

    • New vision_model field on Model definitions to specify a companion vision model per provider.
    • Caching of image descriptions (SHA‑256 fingerprint, configurable path, optional disable).
    • Applied to many models across CommandCode, CrofAI, DeepInfra, Fireworks, OpenCode Go providers.
  • Enhanced Token Usage Tracking

    • Changed metadata keys from total_tokens to total_input_tokens for clarity.
    • Added cached_tokens, cache_creation_tokens, total_tokens, and cost to task/session metadata.
    • Token usage is now merged across turns in ACP sessions and persisted to session store.
    • Console UI and Qt GUI now display total session tokens and cumulative cost.
    • process_message now accepts str | list of messages and an optional model_id parameter, enabling vision model calls.
  • ACP Session Improvements

    • TokenUsage is stored and restored in AcpSessionState.
    • New send_usage_update method pushes token usage, cost, context size, and usage to ACP clients.
    • Session lifecycle persists token_usage as a dict.
  • New Models Added

    • CommandCode: Kimi K2.7 Code HighSpeed, Nemotron 3 Ultra (free), Qwen3.7 Plus (vision).
    • OpenCode Go: Qwen3.7 Plus, removed deprecated mimo-v2-pro, mimo-v2-omni, minimax-m2.5.
    • DeepInfra: Nemotron 3 Super (vision), Qwen 3.5 27B (vision).
    • Fireworks: Vision model assignments for existing models.
  • Model Capability Updates

    • Added vision capability to many models: GPT‑5.3 Codex, GPT‑5.4 Mini, Qwen3.6 Plus, Qwen3.7 Plus, Step 3.7 Flash, MiMo V2.5, Gemini 3.1 Flash Lite, and more for CommandCode provider.
    • Added vision_model references (e.g., xiaomi/mimo-v2.5, google/gemma-4-31B-it, qwen3.6-27b) for models without native vision.

🐛 Bug Fixes

  • Stop Interrupt Handling
    Fixed double token merge when streaming is stopped early – now returns immediately without processing tools after stop.

  • Conversation Fork Token Reset
    Forked conversations now reset token usage metadata (input_tokens, output_tokens, `