Skip to content

[BEAM-8512] Add integration tests for flink_runner.py.#10284

Merged
mxm merged 5 commits intoapache:masterfrom
ibzib:flink-runner
Dec 18, 2019
Merged

[BEAM-8512] Add integration tests for flink_runner.py.#10284
mxm merged 5 commits intoapache:masterfrom
ibzib:flink-runner

Conversation

@ibzib
Copy link

@ibzib ibzib commented Dec 4, 2019

These tests will be part of beam_PostCommit_PortableJar_Flink. Kind of misleading, since as of #10270, portable jars will not actually be used in these tests (they would be expected to fail because of BEAM-8835) but we can use these tests to verify a fix when we have one.

Note that we already have portableWordCountFlinkRunner tests, but those start an embedded Flink cluster so they couldn't test FlinkUberJarJobServer.


Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

  • Choose reviewer(s) and mention them in a comment (R: @username).
  • Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
  • If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang SDK Apex Dataflow Flink Gearpump Samza Spark
Go Build Status --- --- Build Status --- --- Build Status
Java Build Status Build Status Build Status Build Status
Build Status
Build Status
Build Status Build Status Build Status
Build Status
Build Status
Python Build Status
Build Status
Build Status
Build Status
--- Build Status
Build Status
Build Status
Build Status
--- --- Build Status
XLang --- --- --- Build Status --- --- ---

Pre-Commit Tests Status (on master branch)

--- Java Python Go Website
Non-portable Build Status Build Status
Build Status
Build Status Build Status
Portable --- Build Status --- ---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

@ibzib ibzib requested review from mxm and robertwb December 4, 2019 18:31
@ibzib
Copy link
Author

ibzib commented Dec 4, 2019

Run PortableJar_Flink PostCommit

Copy link
Contributor

@mxm mxm left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very nice! Having this will make it much easier to make changes to the flink_runner code.

@ibzib
Copy link
Author

ibzib commented Dec 9, 2019

Run PortableJar_Flink PostCommit

@ibzib
Copy link
Author

ibzib commented Dec 10, 2019

Run PortableJar_Flink PostCommit

@ibzib
Copy link
Author

ibzib commented Dec 10, 2019

Run Seed Job

1 similar comment
@ibzib
Copy link
Author

ibzib commented Dec 16, 2019

Run Seed Job

@ibzib
Copy link
Author

ibzib commented Dec 17, 2019

Run PortableJar_Flink PostCommit

@mxm
Copy link
Contributor

mxm commented Dec 18, 2019

This looks ready to be merged. We can observe the new test over time and tune it further. Thank you!

@mxm mxm merged commit 307dab2 into apache:master Dec 18, 2019
@ibzib
Copy link
Author

ibzib commented Dec 23, 2019

Looks have been intermittent timeouts since this PR. Filed https://issues.apache.org/jira/browse/BEAM-9021

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants