-
Notifications
You must be signed in to change notification settings - Fork 2.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Check whether the input request is too long #113
Comments
Without the fix, cacheflow can suddenly hang without any notice. Let's fix this. |
There are two limits for the sequence length, and we should take whichever is smaller:
The real limit should be Also, for a request:
In addition, we should not directly let the server fail when there is one request that is too long. We should return a proper error message or partial result. |
Closing as this should now be fixed. |
No description provided.
The text was updated successfully, but these errors were encountered: