Skip to content

fix: output reasoning tokens only if supported by model#1105

Merged
tusharmath merged 1 commit intomainfrom
fix/reasoning-for-grok-4
Jul 16, 2025
Merged

fix: output reasoning tokens only if supported by model#1105
tusharmath merged 1 commit intomainfrom
fix/reasoning-for-grok-4

Conversation

@laststylebender14
Copy link
Copy Markdown
Contributor

@laststylebender14 laststylebender14 commented Jul 16, 2025

before this fix: if model outputs any reasoning tokens we were outputting them.
after fix: we output the reasoning tokens only if it's supported by model (it's present in model params)

fixes: #1100

@github-actions github-actions bot added the type: fix Iterations on existing features or infrastructure. label Jul 16, 2025
@laststylebender14 laststylebender14 marked this pull request as ready for review July 16, 2025 05:58
@tusharmath tusharmath merged commit 601c976 into main Jul 16, 2025
8 checks passed
@tusharmath tusharmath deleted the fix/reasoning-for-grok-4 branch July 16, 2025 06:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type: fix Iterations on existing features or infrastructure.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

add a grok4 transformer for thinking

2 participants