Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[ML] Failed data frame transform is restarted when the node restarts #44121

Closed
dolaru opened this issue Jul 9, 2019 · 1 comment · Fixed by #44239
Closed

[ML] Failed data frame transform is restarted when the node restarts #44121

dolaru opened this issue Jul 9, 2019 · 1 comment · Fixed by #44239
Assignees
@benwtrent
Labels
>bug :ml/Transform Transform :ml Machine learning v7.4.0

Comments

@dolaru
Copy link
Member

dolaru commented Jul 9, 2019

Spotted in 7.2.0

A data frame transform that enters the failed state is supposed to stay in that state until it is force-closed.

Currently, this rule is not respected if you restart the node. The task turns into started when the node restarts.

Steps to reproduce

  1. In a single-node cluster, create a data frame transform
  2. Cause a failure in the data frame state: starting the transform then deleting the source data index should do it
  3. Restart the node
  4. Notice that the data frame that was in the failed state has changed to started after restarting.
@dolaru dolaru added >bug :ml Machine learning :ml/Transform Transform labels Jul 9, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/ml-core

@benwtrent benwtrent self-assigned this Jul 11, 2019
@benwtrent benwtrent mentioned this issue Jul 11, 2019
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@benwtrent benwtrent

Labels
>bug :ml/Transform Transform :ml Machine learning v7.4.0
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[ML][Data Frame] prevent task from attempting to run when failed benwtrent/elasticsearch
4 participants
@dolaru @sophiec20 @benwtrent @elasticmachine