Skip to content

v1.4.0

Choose a tag to compare

@paveler paveler released this 06 Nov 13:06
· 19 commits to main since this release
8b5afc4

Added

  • llm fallback chain (SPEC §9.5). llm may be an array of 1–5 full llm objects. The
    run starts on the first entry; any provider failure before the first content event (auth,
    4xx, 429, 5xx, network, queue timeout, context too large) moves it to the next entry,
    without retrying the failed one; the last entry keeps the usual retries. The switch is
    sticky for the rest of the run. Every entry is validated on receipt. The result carries
    llm_used and llm_fallbacks (only for array requests); new SSE event llm_fallback,
    journal event llm_fallback, error-webhook event llm_fallback for runs that survived a
    switch, and llm_fallbacks in run_failed. Each attempt is billed at its own entry's
    price and gets max_tokens clamped to its own model's cap. A single llm object behaves
    exactly as before.