Skip to content

Conversation

zentol
Copy link
Contributor

@zentol zentol commented Jul 11, 2018

What is the purpose of the change

This PR adds an ITCase for the interactions between jar handlers.

The test goes through the following life-cycle:

  • upload jar
  • list jars, expect uploaded jar
  • show plan for uploaded jar
  • run uploaded jar, expect failure during upload to blobserver (no cluster is started)
  • delete uploaded jar
  • list jars, expect empty list

Brief change log

  • sync dispatcher hostname retrieval in JarRunHandler with JobSubmitHandler

  • add TestProgram class and maven-jar-plugin execution to create a test jar for the test

  • modify visibility of various *MessageParameter classes to make them usable for java code

  • add JarSubmissionITCase

Verifying this change

Manually verified. The assertions made are fairly straight-forward.

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): (no)
  • The public API, i.e., is any changed class annotated with @Public(Evolving): (no)
  • The serializers: (no)
  • The runtime per-record code paths (performance sensitive): (no)
  • Anything that affects deployment or recovery: JobManager (and its components), Checkpointing, Yarn/Mesos, ZooKeeper: (no)
  • The S3 file system connector: (no)

Documentation

  • Does this pull request introduce a new feature? (no)
  • If yes, how is the feature documented? (not applicable)

runJar(runHandler, storedJarName, restfulGateway);
Assert.fail("We assume the actual job submission to fail.");
} catch (Exception e) {
final Optional<ConnectException> expected = ExceptionUtils.findThrowable(e, ConnectException.class);
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we can make this part a lot nicer by starting a BlobServer´ like we do in the JobSubmitHandlerTestand setting asubmitFunctionon theTestingDispatcherGateway`.

Will add this later.

Copy link
Contributor

@tillrohrmann tillrohrmann left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding this test @zentol. LGTM. Addressing my comment while merging this PR.

/**
* Tests the entire lifecycle of a jar submission.
*/
public class JarSubmissionITCase {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should extend TestLogger.

asfgit pushed a commit that referenced this pull request Jul 18, 2018
@asfgit asfgit closed this in 28cc072 Jul 18, 2018
@zentol zentol deleted the 9811 branch July 18, 2018 09:30
zentol added a commit to zentol/flink that referenced this pull request Jul 19, 2018
asfgit pushed a commit that referenced this pull request Jul 19, 2018
sampathBhat pushed a commit to sampathBhat/flink that referenced this pull request Jul 26, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants