You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I get the same error. I use the sendChat command and supply an array of ChatMessages to it to provide the whole chat to GPT. It happens when there are lot of messages so I think the problem is when the tokens of all the provided ChatMessages exceeds the token limit of the model. In my case I use 3.5 turbo which has 4096 tokens. I coded it so that it counts each message's tokens using this encoder but even at 3500 tokens it gives this error. Maybe it's related to the amount of ChatMessages supplied?
Anyway, I tested it and at 93 messages which have 3183 tokens it replied. Above that it kept giving an error. That was just one test though
I think I found one of the causes of this error. I have several AI configurations in my app, each with different settings. In one of the configurations I accidentally set the topProbabilityMass to 9.0 instead of 0.9, which is outside of the allowed range for this value. So basically make sure all the values in the API call conform to the requirements of the API
No description provided.
The text was updated successfully, but these errors were encountered: