OPEA integration#328
Conversation
bilgeyucel
left a comment
There was a problem hiding this comment.
Looks good, I left two minor comments @danielfleischer
| github: opea-project | ||
| pypi: https://pypi.org/project/haystack-opea/ | ||
| repo: https://github.com/opea-project/Haystack-OPEA | ||
| type: Distributed Computing |
There was a problem hiding this comment.
Do you want to list OPEA as "model provider" or "distributed computing"? Since the models are inferred through OPEA microservices, "model provider" might be a better choice here
There was a problem hiding this comment.
Hi, good question. Although the current state includes an LLM and an embedder, OPEA components include many more, like vector stores, data prepping, agenting and finetuning microservices, among others. I would defer to your judgment, just wanted to mention these.
There was a problem hiding this comment.
Alright then makes sense! :)
|
|
||
| ## Usage | ||
|
|
||
| Below are quickstart examples for embeddings and LLM generation. Make sure your OPEA backend is running (e.g. via the provided Docker Compose in `samples/`). |
There was a problem hiding this comment.
Can you link to the docs page to run OPEA?
Haystack-OPEA integration, based on https://github.com/opea-project/Haystack-OPEA.