Feature Request for Text Embeddings Inference

[jvhgit]

Validations

• I believe this is a way to improve. I'll try to join the Continue Discord for questions
• I'm not able to find an open issue that requests the same enhancement

Problem

Hi,

Thank you for your work.
I was wondering if you could add support for https://github.com/huggingface/text-embeddings-inference as an embeddingsProvider (like you did with the TGI).
Would be great.

Kind regards,

Solution

No response

[LLukas22]

Just adding that TEI also provides an /rerank endpoint, which could also be implemented as one of the rerankers e.g. when used with models such as jinaai/jina-reranker-v2-base-multilingual.

I would also be willing to add this feature if it is wanted 🤔

[jvhgit]

That would be real nice! I am working on a pilot within my company to see if this could increase development speed and documentation, this would be a real nice feature I can use for the setup.

[jvhgit]

I am closing this issue since it is already implemented! See: https://docs.continue.dev/walkthroughs/codebase-embeddings, the reranking part is not implemented, I suggest that you make a seperate issue.

Kind regards

[Patrick-Erichsen]

@LLukas22 - currently we do not have support for TEI as a reranker (see the available options here).

We'd we welcome a PR to implement it though! Check out https://github.com/continuedev/continue/blob/main/CONTRIBUTING.md to get started and feel free to reach out with any questions in Discord.