Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Transform] Fail requests to start a finished task #106893

Draft
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

prwhelan
Copy link
Member

Batch transforms can be started after they have finished. The Indexer will not try to process any additional changes, so the Transform will be stuck in started until the stop API is called.

Now, the start API will check that the batch transform has not already finished before scheduling the transform to run again. If the transform has already finished, the user will receive a 409 response.

Close #46453

@prwhelan prwhelan added >enhancement :ml/Transform Transform Team:ML Meta label for the ML team v8.14.0 labels Mar 28, 2024
@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/ml-core (Team:ML)

@elasticsearchmachine
Copy link
Collaborator

Hi @prwhelan, I've created a changelog YAML for you.

@prwhelan
Copy link
Member Author

prwhelan commented Apr 1, 2024

@elasticmachine update branch

@prwhelan prwhelan marked this pull request as draft April 1, 2024 14:49
Batch transforms can be started after they have finished. The
Indexer will not try to process any additional changes, so the Transform
will be stuck in `started` until the stop API is called.

Now, the start API will check that the batch transform has not already
finished before scheduling the transform to run again.  If the transform
has already finished, the user will receive a 409 response.

Close elastic#46453
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :ml/Transform Transform Team:ML Meta label for the ML team v8.15.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[ML] Allowing to restart a batch data frame transform job will cause job to stay in "started" state
2 participants