You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi, thanks for the questions. Here we focused more on the LLM part of the REPLUG paper, where documents can be fed in parallel. In general, documents can be retrieved using any method; for the simplicity of the notebook we showed in memory DB that uses BM25 with re-ranker using off-the-shelf sentence transformer. We don't have training code for embedders here, we might add it in the future.
The PromptModel is an abstraction around LLMs where you provide a model name and it generates text based on a prompt, abstracting away whether it is a local model, the hardware specifications or perhaps even a cloud-based service. The API is part of Haystack v1, which we use for the development of our library.
Thanks for your help!
The text was updated successfully, but these errors were encountered: