-
Notifications
You must be signed in to change notification settings - Fork 294
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Large amounts of files uploaded but response is SLOW #316
Comments
Similar to what I experienced #305 |
Do you have any public files that can be used to reproduce the issue? |
Have you resolved this issue? Any technique or thought? thank you |
I can provide some files that are public used such as the one in the attachment. Most of my files are internal used which not public (sorry for that). Anyways, for example, once you uploaded 20 files and each has more than 200 pages. Whenever you ask a question or simple conception, the response from knowledge database is extremely SLOW. |
No, not yet. But my thought was about the cold start from the lambda in NodeJS CustomHandler. I have to try provisioned concurrency and see if it fixes my problem. |
May I ask you which custom handler you are reffering to? |
Lambda was a wrong lead, most-likely related to the search in vector database |
Describe the bug
Sorry for the confusion, but this is not a bug. I have been using this knowledge database for a while. However, after uploading a large amount of files, the response time has become very slow, sometimes taking more than 10 seconds, which negatively impacts the user experience. In comparison, when a small amount of files are uploaded, the database responds much faster.
I'm wondering why this happens and how we (as users) can achieve quick responses even when a large number of files are uploaded.
Furthermore, the current maximum token limit is 4096. Would it be possible to increase the number of tokens?
Thank you very much!
The text was updated successfully, but these errors were encountered: