Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Token limit reached in file search. #367

Open
yuukitakahashi-ava opened this issue Apr 16, 2024 · 0 comments
Open

Token limit reached in file search. #367

yuukitakahashi-ava opened this issue Apr 16, 2024 · 0 comments

Comments

@yuukitakahashi-ava
Copy link

everyone

I uploaded the file and started the chat and AOAI returned an error saying that the token limit has been reached.

I have taken care of this by changing the search limit from 10 to 5 as a simple solution,
However, since this did not occur with the previous UI, we thought there might be another problem and investigated, and discovered that the chunk size was different.

Currently the upper limit is 2300, but previously it was 1000.

We believe that although the chunk size has changed, the search limit has not, and therefore the tokens sent have reached the limit.

Note that we are using gpt-3.5-16k as the model.

We believe that individual users will modify this according to their situation, but we would like to inform you that this phenomenon has occurred.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant