Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Pinecone's hybrid vectors #483

Closed
yasyf opened this issue Jun 29, 2023 · 4 comments
Closed

Support Pinecone's hybrid vectors #483

yasyf opened this issue Jun 29, 2023 · 4 comments

Comments

@yasyf
Copy link

yasyf commented Jun 29, 2023

Is your feature request related to a problem? Please describe.
Recently, Pinecone announced support for Sparse-dense embeddings, allowing for hybrid vector search (both semantic and keyword search). However, haystack doesn't currently support these.

Describe the solution you'd like
Native support for sparse-dense vectors!

Describe alternatives you've considered
I've created a small package called haystack-hybrid-embedding which can be installed to support hybrid vectors for now, but it's a hack!

@TuanaCelik
Copy link
Member

Hey @yasyf thanks for the issue and linking to your repo. I think we already connected on Twitter. As mentioned there, I propose we create an Integration page for you as a first step, at least until we are ready on our side to implement this into the source code of Haystack :)
I am off next week but I'll create the page and send you a preview when I'm back.
Thank you for your contribution 💙

cc: @bilgeyucel

@Azzeo
Copy link

Azzeo commented Jul 3, 2023

As far as I am aware, Weaviate also supports hybrid search. Would that also be something that would be supported?

@bilgeyucel
Copy link
Contributor

bilgeyucel commented Jul 3, 2023

Hi @Azzeo, yes, of course! I can open a separate issue for it. Thank you for letting us know 🙌
Also, I was wondering if you'd like to open a PR for this feature and contribute to Haystack. I am happy to help you throughout the process 😊
Here's the issue btw: #484

@julian-risch julian-risch added the P3 label Jul 5, 2023
@masci masci transferred this issue from deepset-ai/haystack Feb 26, 2024
@anakin87
Copy link
Member

anakin87 commented May 6, 2024

closing in favor of #695

@anakin87 anakin87 closed this as not planned Won't fix, can't repro, duplicate, stale May 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

7 participants