-
-
Notifications
You must be signed in to change notification settings - Fork 13.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add batchSize parameter to Qdrant_VectorStores and QdrantUpsert_Vecto… #2215
Conversation
@@ -257,7 +265,10 @@ class Qdrant_VectorStores implements INode { | |||
|
|||
return res | |||
} else { | |||
await QdrantVectorStore.fromDocuments(finalDocs, embeddings, dbConfig) | |||
for(let i=0; i<finalDocs.length; i+=batchSize) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
name: 'batchSize', | ||
type: 'number', | ||
default: 100, | ||
additionalParams: true |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we have an optional: true
This is a very important fix.. |
… and QdrantUpsert_VectorStores also try calling normal mode if it fail failback to batch mode
In my last commit the batchSize is not required, and I try to POST all at once first and if it fail I fall back to batch mode |
…Upsert_VectorStores
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thanks guys for the PR, merging!
Resolve the bug related to #2191 and #1824 :
Error: 400 Bad Request: Payload error: JSON payload (xxxxxx bytes) is larger than allowed (limit: 33554432 bytes)