Skip to content

Rest embedder - #4509

Merged
meili-bors[bot] merged 9 commits into
mainfrom
rest_embedder
Mar 27, 2024
Merged

meili-bors[bot] merged 9 commits into
mainfrom
rest_embedder

Conversation

@dureuill

@dureuill dureuill commented Mar 19, 2024 •

Copy link
Copy Markdown
Contributor

Fixes #4531

See Usage page

Implementation changes

  • Remove tokio, futures, reqwests
  • Add a new milli::vector::rest::Embedder embedder
  • Update OpenAI and Ollama embedders to use the REST embedder internally
  • Make Embedder::embed a sync method
  • Add the new embedder source as described in the usage

@dureuill dureuill added this to the v1.8.0 milestone Mar 19, 2024
@dureuill dureuill mentioned this pull request Mar 25, 2024
7 of 8 tasks
@dureuill
dureuill marked this pull request as ready for review March 25, 2024 09:35

@ManyTheFish ManyTheFish left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM
bors merge

@meili-bors

meili-bors Bot commented Mar 27, 2024

Copy link
Copy Markdown
Contributor

@meili-bors
meili-bors Bot merged commit 34dfea7 into main Mar 27, 2024
@meili-bors
meili-bors Bot deleted the rest_embedder branch March 27, 2024 10:09
@meili-bot meili-bot added the v1.8.0 PRs/issues solved in v1.8.0 released on 2024-05-06 label May 6, 2024
salmanarshad321 pushed a commit to salmanarshad321/meilisearch that referenced this pull request Sep 23, 2026
4509: Rest embedder r=ManyTheFish a=dureuill

Fixes meilisearch#4531 

See [Usage page](https://meilisearch.notion.site/v1-8-AI-search-API-usage-135552d6e85a4a52bc7109be82aeca42?pvs=25#e6f58c3b742c4effb4ddc625ce12ee16)

### Implementation changes

- Remove tokio, futures, reqwests
- Add a new `milli::vector::rest::Embedder` embedder
- Update OpenAI and Ollama embedders to use the REST embedder internally
- Make Embedder::embed a sync method
- Add the new embedder source as described in the usage


Co-authored-by: Louis Dureuil <louis@meilisearch.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

v1.8.0 PRs/issues solved in v1.8.0 released on 2024-05-06

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add a generic REST embedder

3 participants