Skip to content

Google/Gemini thinking budget support#473

Merged
krissetto merged 1 commit intodocker:mainfrom
krissetto:thinking-budgets-google
Oct 10, 2025
Merged

Google/Gemini thinking budget support#473
krissetto merged 1 commit intodocker:mainfrom
krissetto:thinking-budgets-google

Conversation

@krissetto
Copy link
Copy Markdown
Contributor

Adds thinking budget support for the Google provider

Supports:

  • dynamic thinking (thinking_budget: -1)
  • no thinking (thinking_budget: 0, can't disable on 2.5-pro)
  • token based thinking (thinking_budget <= 24576 for most models, 32768 for 2.5-pro)

Reasoning tokens are also included in usage and cost reporting as well

Closes #70

Signed-off-by: Christopher Petito <chrisjpetito@gmail.com>
@krissetto krissetto requested a review from a team as a code owner October 10, 2025 10:40
@krissetto krissetto merged commit 91b91b2 into docker:main Oct 10, 2025
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[FEAT] - Thinking budgets

2 participants