Repository navigation
v0.93.0
[v0.93.0] - 2026-10-27
Fixed
- A direct provider's spent quota is read from its structure, not its wording: a call with your own keys to OpenAI or a backend on the OpenAI SDK, Anthropic, Google Gemini, Mistral or Amazon Bedrock is a spent quota only on the status, error code or error detail that provider documents for one, and is otherwise retried as
provider.rate_limited. A 429 whose message mentioned a quota, as Gemini's per-minute throttles do, used to fail at once asprovider.quota_exhausted. Anthropic's credit-balance and self-set usage-limit refusals, which carry no code, are still read, by their opening words. - Throttles sent on another status than 429 are retried: OpenRouter's 402 for its in-flight budget, Groq's 498 for its flex tier at capacity, and Bedrock's
ServiceQuotaExceededException, from Bedrock's SDK or from Claude on Bedrock through the Anthropic SDK, are nowprovider.rate_limitedwhere they failed at once. - Gemini's retry delay is carried: the delay Gemini gives in its error's
RetryInfodetail, not in aRetry-Afterheader, is now the failure'sretry_afterand is named in its advice. - A delay in milliseconds is read: a
retry-after-msheader above zero, which Azure OpenAI sends besideretry-after, is now the delay a rate limit carries, read first as the OpenAI and Anthropic SDKs read it, on a call through either SDK, Azure's REST API or a gateway. The transport retry of a call to Azure's REST API now waits that delay too, where it readRetry-Afteralone. - More of Bedrock's wordings of an input over the window are recognized: a
ValidationExceptionsaying "Input Tokens Exceeded" (Amazon Nova), "Too many input tokens" (Amazon Titan) or "prompt tokens (N) exceed model maximum (M)" is nowmodel.context_exceededwhere it wasruntime.unexpected.
Removed
ProviderErrorMetadata.is_quota_exhaustion(Breaking): a plugin readsProviderErrorMetadata.limit_verdictinstead, aProviderLimitVerdictofquota_exhausted,rate_limitedorneither, the one entry point the classifier reads.
What's Changed
- fix/Provider-quota-misread · L-261015-3d5225 by @lchoquel in #1496
- Release v0.93.0 by @lchoquel in #1498
Full Changelog: v0.92.3...v0.93.0