Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Transform] Improve force stop robustness in case of an error #51072

Merged

Conversation

hendrikmuhs
Copy link
Contributor

@hendrikmuhs hendrikmuhs commented Jan 15, 2020

If a transform config got lost (e.g. because the internal index disappeared) tasks could not be stopped using transform API. This change makes it possible to stop transforms without a config, meaning to remove the background task. In order to do so force must be set to true.

@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core (:ml/Transform)

Copy link
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. A few minor things to go through.

@droberts195 droberts195 changed the title [Transform] Robustness: add the possibility to remove dangling tasks on stop [Transform] Improve force stop robustness in case of an error Jan 16, 2020
Copy link
Contributor

@dimitris-athanasiou dimitris-athanasiou left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM Cool, the only thing I'd add would be a test for when the tranform id in the _stop call is a wildcard pattern (e.g. "foo-*"). But i'll leave it on you whether to add it in this PR or another.

@hendrikmuhs hendrikmuhs merged commit 605620c into elastic:master Jan 17, 2020
hendrikmuhs pushed a commit that referenced this pull request Jan 17, 2020
If a transform config got lost (e.g. because the internal index disappeared) tasks could not be
stopped using transform API. This change makes it possible to stop transforms without a config,
meaning to remove the background task. In order to do so force must be set to true.
hendrikmuhs pushed a commit that referenced this pull request Jan 17, 2020
If a transform config got lost (e.g. because the internal index disappeared) tasks could not be
stopped using transform API. This change makes it possible to stop transforms without a config,
meaning to remove the background task. In order to do so force must be set to true.
hendrikmuhs pushed a commit that referenced this pull request Jan 20, 2020
check custom meta data to avoid NPE, fixes a problem introduced in #51072

fixes #51153
hendrikmuhs pushed a commit that referenced this pull request Jan 20, 2020
check custom meta data to avoid NPE, fixes a problem introduced in #51072

fixes #51153
hendrikmuhs pushed a commit that referenced this pull request Jan 20, 2020
check custom meta data to avoid NPE, fixes a problem introduced in #51072

fixes #51153
SivagurunathanV pushed a commit to SivagurunathanV/elasticsearch that referenced this pull request Jan 23, 2020
…c#51072)

If a transform config got lost (e.g. because the internal index disappeared) tasks could not be
stopped using transform API. This change makes it possible to stop transforms without a config,
meaning to remove the background task. In order to do so force must be set to true.
SivagurunathanV pushed a commit to SivagurunathanV/elasticsearch that referenced this pull request Jan 23, 2020
check custom meta data to avoid NPE, fixes a problem introduced in elastic#51072

fixes elastic#51153
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants