Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DOC] Score Normalization and Combination for Semantic Search #4351

Closed
1 of 2 tasks
martin-gaievski opened this issue Jun 15, 2023 · 1 comment · Fixed by #4985
Closed
1 of 2 tasks

[DOC] Score Normalization and Combination for Semantic Search #4351

martin-gaievski opened this issue Jun 15, 2023 · 1 comment · Fixed by #4985
Assignees
Labels
3 - Done Issue is done/complete v2.10.0
Milestone

Comments

@martin-gaievski
Copy link
Member

martin-gaievski commented Jun 15, 2023

What do you want to do?

  • Request a change to existing documentation
  • Add new documentation

Tell us about your request.
We are introducing ability to combine scores from multiple queries in one query, with control on how scores are normalized (as for each query score can be at different scale) and how score are combined (e.g. sum up or take average of scores for the same doc from different queries). Typically customers are doing this today in external system after running multiple queries independently, we want to provide a one stop point for this in OpenSearch.
As part of this feature we create new Hybrid query type (neural-search plugin), extend core OpenSearch to allow adding new type of injector processor to search pipelines and registering one new processor (part of neural-search plugin)
Feature is planned for 2.10 release.

What other resources are available?
RFC that describes the approach at high level: opensearch-project/neural-search#126
RFC for new phase in search pipelines: opensearch-project/neural-search#152

@Naarcha-AWS Naarcha-AWS added v2.10.0 1 - Backlog Issue: The issue is unassigned or assigned but not started and removed untriaged labels Jun 22, 2023
@kolchfa-aws kolchfa-aws self-assigned this Jul 6, 2023
@hdhalter hdhalter added this to the v2.10 milestone Aug 9, 2023
@kolchfa-aws kolchfa-aws added 2 - In progress Issue/PR: The issue or PR is in progress. and removed 1 - Backlog Issue: The issue is unassigned or assigned but not started labels Sep 6, 2023
@hdhalter
Copy link
Contributor

Fixes #4406

@hdhalter hdhalter added 3 - Done Issue is done/complete and removed 2 - In progress Issue/PR: The issue or PR is in progress. labels Sep 20, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Done Issue is done/complete v2.10.0
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants