v1.8 hybrid search changes #4548
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
dureuill
force-pushed
the
improve_hybrid_search
branch
from
fd19e6a
to
13ec06c
Compare
7 tasks
dureuill
force-pushed
the
improve_hybrid_search
branch
from
13ec06c
to
ca499a0
Compare
irevoire
requested changes
Apr 4, 2024
Co-authored-by: Tamo <tamo@meilisearch.com>
meili-bors bot
added a commit
that referenced
this pull request
Apr 4, 2024
4548: v1.8 hybrid search changes r=irevoire a=dureuill Implements the search changes from the [usage page](https://meilisearch.notion.site/v1-8-AI-search-API-usage-135552d6e85a4a52bc7109be82aeca42#40f24df3da694428a39cc8043c9cfc64) ###⚠️ Breaking changes in an experimental feature: - Removed the `_semanticScore`. Use the `_rankingScore` instead. - Removed `vector` in the response of the search (output was too big). - Removed all the vectors from the `vectorSort` ranking score details - target vector appearing in the name of the rule - matched vector appearing in the details of the rule ### Other user-facing changes - Added `semanticHitCount`, indicating how many hits were returned from the semantic search. This is especially useful in the hybrid search. - Embed lazily: Meilisearch no longer generates an embedding when the keyword results are "good enough". - Graceful embedding failure in hybrid search: when doing hybrid search (`semanticRatio in ]0.0, 1.0[`), an embedding failure no longer causes the search request to fail. Instead, only the keyword search is performed. When doing a full vector search (`semanticRatio==1.0`), a failure to embed will still result in failing that search. Co-authored-by: Louis Dureuil <louis@meilisearch.com>
|
Build failed:
|
|
bors merge |
|
Build succeeded:
|
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Implements the search changes from the usage page
_semanticScore. Use the_rankingScoreinstead.vectorin the response of the search (output was too big).vectorSortranking score detailsOther user-facing changes
semanticHitCount, indicating how many hits were returned from the semantic search. This is especially useful in the hybrid search.semanticRatio in ]0.0, 1.0[), an embedding failure no longer causes the search request to fail. Instead, only the keyword search is performed. When doing a full vector search (semanticRatio==1.0), a failure to embed will still result in failing that search.