Skip to content

v0.4.0

Choose a tag to compare

@TheStreamCode TheStreamCode released this 21 Jun 20:35
· 25 commits to main since this release

Auto (router) model

Adds a virtual Auto (router) model that delegates model selection and automatic fallback to Chutes' native model router. Pick it in the model list and your prompt is classified and routed to a suitable model; if that model is cold or unavailable, the router fails over automatically — no manual switching.

New settings

  • chutes.autoRouterEnabled (default true) — show the Auto (router) model.
  • chutes.routerEndpoint (default https://model-router-ten.vercel.app/v1) — base URL of the native router.

Install: download the .vsix below and run Extensions: Install from VSIX…, or install from the VS Code Marketplace.