[FLINK-8634] [rest] Introduce job rescaling REST handler #5453
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
tillrohrmann
force-pushed
the
rescalingHandlers
branch
6 times, most recently
from
921bce8 to
3810996
Compare
tillrohrmann
force-pushed
the
rescalingHandlers
branch
from
3810996 to
8a7ceb4
Compare
The new JobStatus#SUSPENDING says that an ExecutionGraph has been suspended but its clean up has not been done yet. Only after all Executions have been canceled, the ExecutionGraph will enter the SUSPENDED state and complete the termination future accordingly. This closes apache#5445.
This commit adds the functionality to rescale a job or parts of it to the JobMaster. In order to rescale a job, the JobMaster does the following: 1. Take a savepoint 2. Create a rescaled ExecutionGraph from the JobGraph 3. Initialize it with the taken savepoint 4. Suspend the old ExecutionGraph 5. Restart the new ExecutionGraph once the old ExecutionGraph has been suspended This closes apache#5446.
This commit exposes the JobMaster#rescaleJob via the Dispatcher. This will allow it to call this functionality from a REST handler. This closes apache#5452.
This commit allows the Restclient to receive generic response types. In order to do this, the MessageHeaders contain now information about the generic type parameters of the response type. This closes apache#5450.
…dlers The asynchronous operation handlers are the generalization of the SavepointHandlers. They consist of a Trigger- and a StatusHandler. The TriggerHandler is used to trigger an asynchronous operation. The handler stores the operation future and returns a trigger id. The trigger id can be used to query the status of the operation via the StatusHandler. Once the operation has completed, the StatusHandler will return the result. This closes apache#5451.
Add rescaling REST handler as a sub class of the AbstractAsynchronousOperationHandlers. This closes apache#5451.
tillrohrmann
force-pushed
the
rescalingHandlers
branch
from
8a7ceb4 to
a6e213e
Compare
Contributor
Author
|
Merged |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What is the purpose of the change
Add rescaling REST handler as a sub class of the
AbstractAsynchronousOperationHandlers.This PR is based on #5452 and #5451.
Does this pull request potentially affect one of the following parts:
@Public(Evolving): (no)Documentation