"max context token" not work for anthropic models. #3447
-
What happened?"max context token" function with the anthropic model does not work. Steps to Reproduce
What browsers are you seeing the problem on?No response Relevant log outputSomething went wrong. Here's the specific error message we encountered: Operation failed after 3 attempts: 400 {"type":"error","error":{"type":"invalid_request_error","message":"messages: at least one message is required"}}
This is the setting. ScreenshotsCode of Conduct
|
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 4 replies
-
If you're setting context this low, you need to match the output tokens respectively. It's recommended you use a preset for this as well to avoid setting it every time. From your screenshot, you have output tokens set to 8192 and the context gets screwed up to -6192. if you want to give the model 1500 response tokens, your settings should be: Max Context Tokens: 2000
Max Output Tokens: 1500 this by proxy limits the user prompt, with or without any previous messages, to 500 tokens. |
Beta Was this translation helpful? Give feedback.
If you're setting context this low, you need to match the output tokens respectively. It's recommended you use a preset for this as well to avoid setting it every time.
From your screenshot, you have output tokens set to 8192 and the context gets screwed up to -6192.
if you want to give the model 1500 response tokens, your settings should be:
this by proxy limits the user prompt, with or without any previous messages, to 500 tokens.