Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ML] Allow user settings for data frame analytics destination index #68514

Open
dimitris-athanasiou opened this issue Feb 4, 2021 · 4 comments
Labels
>enhancement :ml Machine learning

Comments

@dimitris-athanasiou
Copy link
Contributor

There are 2 scenarios wrt to the destination index of a data frame analytics job:

  1. The index is not created when the job starts; then the job creates the index and copies over source indices mappings
  2. The index has been already created when the job starts; then the job assumes the user customized index settings and mappings and only adds the analysis result object mappings.

However, there is a use case where the user does not want to deal with mappings copying, yet they need to specify extra settings (e.g. change fields limit, etc.). We can address this by adding the ability to specify index settings in the dest index config of a data frame analytics job.

@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml)

@przemekwitek
Copy link
Contributor

Just a random idea: could this be handled by the user providing the index template (containing settings) instead?
Or do you think having this settings section in DFA config would simplify overall UX significantly?

@dimitris-athanasiou
Copy link
Contributor Author

Note that there are now plans for an API that allows preparing a target index for reindex #68857. I think this might solve all of our concerns here.

@dimitris-athanasiou
Copy link
Contributor Author

As of #91546 we now copy more settings from the source indices to the destination index.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :ml Machine learning
Projects
None yet
Development

No branches or pull requests

3 participants