Skip to content

v0.0.466

Choose a tag to compare

@github-actions github-actions released this 18 Jul 17:45
· 1636 commits to main since this release
f32233e

Version 0.0.466 (July 18, 2026)

  • Auto model router — a new org setting (Settings → LLM, off by default) that routes each request to the cheapest capable model. When a user picks no model, the run starts on the small model and the agent escalates to a stronger one only when the task needs it, via a route_model tool whose choices are the models you give routing guidance to; the escalation propagates to code generation too. Explicit per-message picks and report-pinned models always bypass routing. In a 10-question analytics benchmark on the demo dataset (65 model calls, small=GPT-4o mini vs default=GPT-4o), the router handled every question on the small model at held quality (LLM-judge 4/5 across the board) for a measured ~95% lower LLM cost ($0.09 vs $2.04); real-world savings scale with your traffic mix and how often escalation is actually needed.
  • Realized routing savings on the cost console — completions made under the router are credited against the model that would otherwise have run, so the LLM Usage Cost card and /monitoring/cost show a "Saved by auto-routing" KPI (dollars saved, share of calls routed) over any date range.
  • Edit per-model pricing — admins can set a model's input/output price per million tokens inline in Settings → LLM (Cost column). Corrects preset rates or prices a self-hosted model, and feeds both the cost console and the router savings math.