Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a Wrapper vectorstore, compatible with SelfQueryRetriever #13190

Closed

Conversation

pprados
Copy link
Contributor

@pprados pprados commented Nov 10, 2023

Description:
The SelfQueryRetriever component is able to convert filter clauses for different vectorstore implementations.
If we wish to offer advanced use of vectorstore, by modifying for example certain methods, via a wrapper type approach, we lose the ability to use SelfQueryRetriever.

We propose to standardize vectorstore wrapper exploitation, to allow flexible integration with SelfQueryRetriever.
The idea is to add to _get_builtin_translator(), taking into account the wrapper.
Thus, every vectorstore wrapper automatically benefits from the SelfQueryRetriever.

This is the prelude to another full-request, which needs a vectorstore wrapper, while being compatible
with SelfQueryRetriever.

Tag maintainer:
@baskaryan

Twitter handle:
@pprados

Copy link

vercel bot commented Nov 10, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Comments Updated (UTC)
langchain ⬜️ Ignored (Inspect) Visit Preview Nov 27, 2023 9:45am

@dosubot dosubot bot added Ɑ: vector store Related to vector store module 🤖:improvement Medium size change to existing code to handle new use-cases labels Nov 10, 2023
@pprados pprados force-pushed the pprados/wrapper_vectorstore branch 9 times, most recently from 91dcce0 to 3a9c4bd Compare November 10, 2023 15:35
pprados added a commit to pprados/langchain-rag that referenced this pull request Nov 10, 2023
- [Add a Wrapper vectorstore, compatible with SelfQueryRetriever](langchain-ai/langchain#13190)
- [Adds an in-memory implementation of RecordStore](langchain-ai/langchain#13200)
- [Add SQLDocStore](langchain-ai/langchain#13181)
@pprados pprados marked this pull request as draft November 10, 2023 16:39
@pprados pprados force-pushed the pprados/wrapper_vectorstore branch 5 times, most recently from 823f8dc to a46378a Compare November 21, 2023 12:00
@pprados pprados marked this pull request as ready for review November 21, 2023 13:18
@dosubot dosubot bot added the size:XL This PR changes 500-999 lines, ignoring generated files. label Nov 21, 2023
@pprados pprados force-pushed the pprados/wrapper_vectorstore branch from 268f6f2 to 0f47246 Compare November 23, 2023 09:50
@dosubot dosubot bot added size:L This PR changes 100-499 lines, ignoring generated files. and removed size:XL This PR changes 500-999 lines, ignoring generated files. labels Nov 23, 2023
@pprados pprados force-pushed the pprados/wrapper_vectorstore branch 2 times, most recently from 6378ab1 to 7042880 Compare November 23, 2023 10:27
@pprados pprados closed this Nov 27, 2023
@pprados pprados force-pushed the pprados/wrapper_vectorstore branch from 7042880 to bfc12a4 Compare November 27, 2023 09:44
@dosubot dosubot bot added size:XS This PR changes 0-9 lines, ignoring generated files. and removed size:L This PR changes 100-499 lines, ignoring generated files. labels Nov 27, 2023
@pprados pprados deleted the pprados/wrapper_vectorstore branch November 27, 2023 09:45
@pprados pprados restored the pprados/wrapper_vectorstore branch November 27, 2023 10:24
@pprados
Copy link
Contributor Author

pprados commented Dec 1, 2023

@baskaryan, I see the pull request successfully merged and closed, but I not see the code in the master branch.
what didn't I understand?

@pprados pprados deleted the pprados/wrapper_vectorstore branch January 23, 2024 14:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🤖:improvement Medium size change to existing code to handle new use-cases size:XS This PR changes 0-9 lines, ignoring generated files. Ɑ: vector store Related to vector store module
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants