Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] [Search Comparison Tool] Saved Configurations #284

Open
sejli opened this issue Sep 12, 2023 · 1 comment
Open

[FEATURE] [Search Comparison Tool] Saved Configurations #284

sejli opened this issue Sep 12, 2023 · 1 comment
Assignees
Labels
enhancement New feature or request v2.12.0

Comments

@sejli
Copy link
Collaborator

sejli commented Sep 12, 2023

Is your feature request related to a problem?

As the search comparison tool continues to add features that rely on user customization, like #260, the information needed to run search comparisons increases. If a user wants to revisit a previous one, all prompts must be re-entered to achieve the desired comparison.

What solution would you like?

As described in #260, we want consider the concept of a search configuration:

Think of a search configuration as a unit containing anything that you would want to compare to another search configuration for manual comparison or A/B testing. This would include queries, ML models, search pipelines, processor configurations, analyzers, etc.

We want users to be able to save search configurations made in the tool. This opens up the option for users to:

  1. Revisit comparisons without re-entering information in the prompts
  2. Share saved comparisons with others using URLs, similar to how saved logs can be accessed in log explorer

What alternatives have you considered?

Currently, the only way to reproduce a search comparison is to copy and paste all the information back into the tool's prompts. As configurations get more complex, this becomes increasingly tedious.

Do you have any additional context?

In preparation for this blog post, saved configurations has a prototype as shown in the ML playground. Users can click links to access saved configurations that have been pre-populated with queries relevant to semantic search.

@sejli sejli added enhancement New feature or request untriaged labels Sep 12, 2023
@sejli sejli self-assigned this Sep 12, 2023
@macohen macohen removed the untriaged label Sep 15, 2023
@noCharger
Copy link
Collaborator

There is some overlapping with #261

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request v2.12.0
Projects
Status: 🆕 New
Development

No branches or pull requests

3 participants