added Brave Search document_loader

[leo-gan]

• Added Brave Search document loader.
• Refactored BraveSearch wrapper
• Added a Jupyter Notebook example
• Added Ecosystem/Integrations BraveSearch page

Please review:

• DataLoaders / VectorStores / Retrievers: @rlancemartin, @eyurtsev

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment

Name	Status	Preview	Comments	Updated (UTC)
langchain	⬜️ Ignored (Inspect)			Jul 2, 2023 11:17pm

[rlancemartin]

Thanks for adding. Nit:

Please update your current load method to lazy_load -

def lazy_load(self) -> Iterator[Document]:

And then simply add a new load method that calls lazy_load -

def load(self) -> List[Document]:
        """Loads a query result from Brave Search engine into a list of Documents."""
        return list(self.lazy_load())

[leo-gan]

@rlancemartin Not sure, I got it. download_documents() returns a list not an iterable.
I can do lazy_load from it. But converting the list to iterable and then back to the list?

[rlancemartin]

@rlancemartin Not sure, I got it. download_documents() returns a list not an iterable.

I can do lazy_load from it. But converting the list to iterable and then back to the list?

Right. All of the new loaders have lazy_load method (useful in the case of loading a larger volume of docs since it returns a generator). But we keep load method for ease of use, which just calls lazy_load. You can see other examples such as this. It's a minor change.