v0.0.466
·
1636 commits
to main
since this release
Version 0.0.466 (July 18, 2026)
- Auto model router — a new org setting (Settings → LLM, off by default) that routes each request to the cheapest capable model. When a user picks no model, the run starts on the small model and the agent escalates to a stronger one only when the task needs it, via a
route_modeltool whose choices are the models you give routing guidance to; the escalation propagates to code generation too. Explicit per-message picks and report-pinned models always bypass routing. In a 10-question analytics benchmark on the demo dataset (65 model calls, small=GPT-4o mini vs default=GPT-4o), the router handled every question on the small model at held quality (LLM-judge 4/5 across the board) for a measured ~95% lower LLM cost ($0.09 vs $2.04); real-world savings scale with your traffic mix and how often escalation is actually needed. - Realized routing savings on the cost console — completions made under the router are credited against the model that would otherwise have run, so the LLM Usage Cost card and
/monitoring/costshow a "Saved by auto-routing" KPI (dollars saved, share of calls routed) over any date range. - Edit per-model pricing — admins can set a model's input/output price per million tokens inline in Settings → LLM (Cost column). Corrects preset rates or prices a self-hosted model, and feeds both the cost console and the router savings math.