Skip to content

v0.27.9

Latest

Choose a tag to compare

@yuanhao yuanhao released this 15 Nov 15:24
0332b38

One fix, no breaking changes. yoagent-rutis (0.13.0) and yoagent-workers (0.4.0) are unchanged.

  • Bedrock with thinking on always sends maxTokens above the thinking budget. Anthropic requires budget_tokens < max_tokens; the Bedrock provider sent inferenceConfig.maxTokens only when the request set one, and never raised it. It now applies the first-party Anthropic rule: the request's max_tokens, else the model config's, else 8,192, raised to budget + 1024 when it does not exceed the budget. A preset's max_tokens (e.g. 64,000) is now sent with thinking on, and Bedrock reserves it against the account's tokens-per-minute quota while the request runs; set a smaller max_tokens if that throttles you. With thinking off nothing changes (#453, yoyo-evolve#1198).