Skip to content

v0.22.0 — Inference providers: chat with any model you already have

Choose a tag to compare

View all tags
@thrashr888 thrashr888 released this 21 Jul 08:25
v0.22.0
22b18f9

Highlights

  • Chat with any model you already have. One provider list covers your coding-agent subscriptions (Claude Code, Codex, Gemini CLI, Cursor, OpenCode, GitHub Copilot, Hermes, IBM Bob — run headless, your existing sign-ins carry the bill), API gateways (30+ presets from OpenAI and Anthropic to NVIDIA, OpenRouter, and Groq, plus any custom OpenAI-compatible endpoint), and local servers. Switch anytime from the model pill in the chat box; answers are captioned with the model that wrote them, including metered cost when the provider reports one.
  • On-device chat on macOS 26. With Apple Intelligence enabled, Apple's on-device model answers entirely offline — no server, no account. Retrieval tightens automatically to fit its smaller window, verified against the recall eval suite.
  • Failures you can act on. Provider errors land in the transcript as durable rows in plain language — out of credit, model unavailable on this account, sign-in expired — with a Retry button, a one-click "Open Terminal" fix that launches the right sign-in command, or a jump straight to model settings. Hung providers fail in seconds instead of spinning forever.
  • Route studio work separately. Studio generation and helper tasks (titles) can use a different provider than chat, with graceful fallbacks — pair local chat with a heavyweight generator, or the reverse.
  • Setup with three doors. First run offers: use a subscription you already pay for, paste an API key (the wizard probes it and picks a working model), or stay fully local. Editing a provider re-probes and shows the live model list.

Notes

  • Saving settings is instant now, even mid-generation, and switching providers can't bleed into an in-flight answer.
  • Embeddings stay on the built-in private embedder by default and remain deliberately separate from chat.
  • Message history records the answering model; messages from before this release show no caption.
  • Full design in docs/RFC-inference-providers.md.

Full Changelog: v0.21.0...v0.22.0

Assets 6
Loading