Skip to content

Conversation

@tillrohrmann
Copy link
Contributor

What is the purpose of the change

Fail fatally if we cannot recover the job on the onAddedJobGraph signal from the SubmittedJobGraphListener.

Verifying this change

  • Added DispatcherTest#testOnAddedJobGraphRecoveryFailure and DispatcherTest#testOnAddedJobGraphWithFinishedJob

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
  • The serializers: (no)
  • The runtime per-record code paths (performance sensitive): (no)
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (yes)
  • The S3 file system connector: (no)

Documentation

  • Does this pull request introduce a new feature? (no)
  • If yes, how is the feature documented? (not applicable)


@Override
public CompletableFuture<Collection<JobID>> listJobs(Time timeout) {
if (jobManagerRunners.isEmpty()) {
Copy link
Member

@GJL GJL Jun 28, 2018

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nice (this is not a review)

@tillrohrmann
Copy link
Contributor Author

Thanks for the review @GJL. Merging this PR into master and release-1.5 branch.

@tillrohrmann tillrohrmann force-pushed the hardenOnAddedJobGraph branch from 2d5835f to 2be3b0e Compare June 29, 2018 15:39
tillrohrmann added a commit to tillrohrmann/flink that referenced this pull request Jun 29, 2018
tillrohrmann added a commit to tillrohrmann/flink that referenced this pull request Jun 29, 2018
@tillrohrmann tillrohrmann force-pushed the hardenOnAddedJobGraph branch from 2be3b0e to 7b4cb52 Compare June 29, 2018 17:12
asfgit pushed a commit that referenced this pull request Jun 30, 2018
@asfgit asfgit merged commit 7b4cb52 into apache:master Jun 30, 2018
@tillrohrmann tillrohrmann deleted the hardenOnAddedJobGraph branch June 30, 2018 17:01
sampathBhat pushed a commit to sampathBhat/flink that referenced this pull request Jul 26, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants