-
-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug]: 256 tokens output max #1690
Comments
🤖 Hello @StanGirard, Great to see you again! I hope you're doing well. Based on the context provided, the output limit of 256 tokens you're experiencing doesn't seem to be directly related to the Quivr codebase. The tokens = 0
for doc in documents:
tokens += len(doc.page_content) * 1.5
if tokens > 3000:
documents.remove(doc) This code is found in backend/repository/brain/get_question_context_from_brain.py. Additionally, there is no specific function or part of the Quivr codebase that limits the output to 256 tokens according to the context provided. The function Lastly, while Quivr does not have a specific setting that limits the output to 256 tokens, there is a token limitation in the If the output is indeed limited to 256 tokens, it might be due to another part of the code or a different function that is not provided in the given context. Could you provide more information about the operations you're performing when you encounter this limit? This could help in identifying the source of the issue. Sources |
What happened?
A bug happened!
Whatever I do it is only 256 tokens output max
Relevant log output
Twitter / LinkedIn details
No response
The text was updated successfully, but these errors were encountered: