Fixes for add and delete Methods in LanceDBVectorStore #11825
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Two fixes to the LanceDBVectorStore class. These fixes address issues encountered when invoking the add method with an empty list and using an incorrect field name in the delete method. I encountered this errors while using LanceDB with Ingestion Pipeline + Document Management (similar to this but with LanceDB vector store), when the ingestion pipeline tries to apply the changes in documents to the vector database.
I've created this Colab to reproduce the issues:
https://colab.research.google.com/drive/1F-3NNPv1zcJLA6NDdE2QtaqAuF3V5P1F?usp=sharing
Handling Empty List in add Method
Invoking add([]) leads to an IndexError due to an attempt to access the first element of an empty list in the . Added a check at the beginning of the add method to return early if the input list is empty.
Correcting Field Name in delete Method
The delete method uses an incorrect field name (document_id) for deletion, the field name is set here, when deleting it should use the same field name.
Version Bump?
Did I bump the version in the
pyproject.toml
file of the package I am updating? (Except for thellama-index-core
package)Type of Change
Please delete options that are not relevant.
How Has This Been Tested?
Please describe the tests that you ran to verify your changes. Provide instructions so we can reproduce. Please also list any relevant details for your test configuration
Suggested Checklist:
make format; make lint
to appease the lint gods