[BEAM-2999] Move ValidatesRunner test out of Python postcommit

[markflyhigh]

Follow this checklist to help us incorporate your contribution quickly and easily:

• Make sure there is a JIRA issue filed for the change (usually before you start working on it). Trivial changes like typos do not require a JIRA issue. Your pull request should address just this issue, without pulling in other changes.
• Each commit in the pull request should have a meaningful subject line and body.
• Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue.
• Write a pull request description that is detailed enough to understand what the pull request does, how, and why.
• Run mvn clean verify to make sure basic checks pass. A more thorough check will be performed on your pull request automatically.
• If this contribution is large, please file an Apache Individual Contributor License Agreement.

---

Create separate Jenkins build for Python validatesrunner tests and move them out of beam_PostCommit_Python_Verify.

beam_PostCommit_Python_Verify is pretty heavy combining with unit tests, validatesrunner tests and end-to-end tests, and the total time increase to 1 hour recently. This change can reduce the load of beam_PostCommit_Python_Verify and log will be cleaner for debugging if either build failed.

[markflyhigh]

Run Seed Job

[markflyhigh]

Run Seed Job

[markflyhigh]

Run Python Dataflow ValidatesRunner

[markflyhigh]

+R: @aaltay

[aaltay]

Thank you @markflyhigh. I left a question for you.

[markflyhigh]

@aaltay um.. where is the question? looks like comments and JIRA are empty...

[aaltay]

Do we still use postcommit_requirements.txt in this file?

[markflyhigh]

thanks for the catch. I checked existing validatesrunner tests and none of them use pyhamcrest and mock. Will remove it.

[aaltay]

Forgot to post the question :), please take a look again.

[markflyhigh]

Run Python Dataflow ValidatesRunner

[aaltay]

LGTM. I can merge after tests pass. Could you also run the modified post commit tests?

[markflyhigh]

@aaltay I mistakenly remove hamcrest and mock from VR test. Should remove from run_post_commit.sh. Will fix this and rerun both two tests.

[markflyhigh]

Run Python Dataflow ValidatesRunner

[markflyhigh]

Run Python PostCommit

[coveralls]

Changes Unknown when pulling b7a116e on markflyhigh:python-split-postcommit into ** on apache:master**.

[aaltay]

retest this please

[markflyhigh]

retest this please

[coveralls]

Changes Unknown when pulling b7a116e on markflyhigh:python-split-postcommit into ** on apache:master**.

[markflyhigh]

Python precommit failed on timeout. However, I checked log of sdk/python build, all tox build were executed and passed. Is it good for the testing? @aaltay

[aaltay]

That is fine, I will merge it. Please pay attention to tests, after the merge. Do you know if there is a JIRA issue for the timeouts?