Allow default max token #947
luguanyu1234
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently, if
default_max_tokensis not set, it defaults to 0 on the server. I propose setting it to null instead, allowing the server to use its default max tokens value. This would make the default_max_tokens parameter optional, aligning with common practices for optional configuration settings. Any thoughts on this change?Beta Was this translation helpful? Give feedback.
All reactions