You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I uploaded the file and started the chat and AOAI returned an error saying that the token limit has been reached.
I have taken care of this by changing the search limit from 10 to 5 as a simple solution,
However, since this did not occur with the previous UI, we thought there might be another problem and investigated, and discovered that the chunk size was different.
Currently the upper limit is 2300, but previously it was 1000.
We believe that although the chunk size has changed, the search limit has not, and therefore the tokens sent have reached the limit.
Note that we are using gpt-3.5-16k as the model.
We believe that individual users will modify this according to their situation, but we would like to inform you that this phenomenon has occurred.
The text was updated successfully, but these errors were encountered:
everyone
I uploaded the file and started the chat and AOAI returned an error saying that the token limit has been reached.
I have taken care of this by changing the search limit from 10 to 5 as a simple solution,
However, since this did not occur with the previous UI, we thought there might be another problem and investigated, and discovered that the chunk size was different.
Currently the upper limit is 2300, but previously it was 1000.
We believe that although the chunk size has changed, the search limit has not, and therefore the tokens sent have reached the limit.
Note that we are using gpt-3.5-16k as the model.
We believe that individual users will modify this according to their situation, but we would like to inform you that this phenomenon has occurred.
The text was updated successfully, but these errors were encountered: