Skip to content

Conversation

@jif-oai
Copy link
Collaborator

@jif-oai jif-oai commented Jan 13, 2026

After evals, 0 impact on performance

@jif-oai jif-oai marked this pull request as ready for review January 14, 2026 16:14
let max_tokens = resolve_max_tokens(request.max_output_tokens);
let yield_time_ms = clamp_yield_time(request.yield_time_ms);
let yield_time_ms = {
let time_ms = clamp_yield_time(request.yield_time_ms);
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

do we need to pre clamp before the condition?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is cheap and my logic was: if one day we add some custom logic in it, might be worth it to keep. But this is mostly because it's basically free

@jif-oai jif-oai merged commit 32b1795 into main Jan 14, 2026
28 of 32 checks passed
@jif-oai jif-oai deleted the jif/clamp-wait branch January 14, 2026 16:25
@github-actions github-actions bot locked and limited conversation to collaborators Jan 14, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants