@asyncify-hq/node@0.8.4
·
39 commits
to main
since this release
Patch Changes
- 71b5802: Cheap-first model routing is now typed on the client.
agents.update(id, { routing: { enabled, cheapModel } })puts a managed agent's simple replies on a smaller model; the moment a routed turn reaches for a consequential tool — a workflow, one of your own tools, a knowledge lookup — the whole turn is discarded and re-run on the agent's main model, so a small model is trusted to talk and never to act.cheapModelmust be an id your own LLM endpoint serves (routing rides the agent's key and base URL) and has no default; a wrong id is safe, since the failed cheap call just escalates.routing: nullswitches it off and forgets the config, andAgentgains theroutingfield the API now returns.EvalRunCandidategainsroutingtoo, so a pre-save check can grade the router the operator is about to turn on — the run executes through it rather than merely recording it, and an explicitnullgrades the agent with routing off. Managed agents only: a bridge agent answers 400.