feat: faiss filter from list

[HenriZuber]

Feature

Using FAISS on a retrievalQA task, I found myself wanting to allow in multiple sources. From what I understood, the filter feature takes in a dict of form {key: value} which then will check in the metadata for the exact value linked to that key.
I added some logic to be able to pass a list which will be checked against instead of an exact value. Passing an exact value will also work.

Here's an example of how I could then use it in my own project:

    pdfs_to_filter_in = ["file_A", "file_B"]
    filter_dict = {
        "source": [f"source_pdfs/{pdf_name}.pdf" for pdf_name in pdfs_to_filter_in]
    }
    retriever = db.as_retriever()
    retriever.search_kwargs = {"filter": filter_dict}

I added an integration test based on the other ones I found in tests/integration_tests/vectorstores/test_faiss.py under test_faiss_with_metadatas_and_list_filter().

It doesn't feel like this is worthy of its own notebook or doc, but I'm open to suggestions if needed.

Who can review?

Tag maintainers/contributors who might be interested:

VectorStores related: @dev2049

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
langchain	⬜️ Ignored (Inspect)			Jun 21, 2023 5:04pm

[dev2049]

thanks @HenriZuber!