[BEAM-7223] Add ValidatesRunner for Flink for python 3.5 - 3.6 - 3.7

[fredo838]

This is is part of a series of PRs with goal to make Apache Beam PY3 compatible. The proposal with the outlined approach has been documented here: https://s.apache.org/beam-python-3.

This PR adds ValidatesRunner tests for Flink, as well as mirroring the file structure in test-suites/dataflow

---

Lang	SDK	Apex	Dataflow	Flink	Gearpump	Samza	Spark
Go		---	---		---	---
Java
Python		---			---	---

Pre-Commit Tests Status (on master branch)

---	Java	Python	Go	Website
Non-portable
Portable	---		---	---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

[fredo838]

R: @tvalentyn

[fredo838]

Run Python PreCommit

[fredo838]

Run Python PreCommit

[tvalentyn]

retest this please

[angoenka]

Instead of creating copies for each python versions, can we do something like

beam/runners/flink/1.8/job-server/build.gradle

Line 31 in a6c9c92

apply from: "$basePath/flink_job_server.gradle"

[fredo838]

Run Python_PVR_Flink PreCommit

[fredo838]

Run Python_PVR_Flink PreCommit

[fredo838]

Run Python_PVR_Flink PreCommit

[fredo838]

Run Python_PVR_Flink PreCommit

[fredo838]

@tvalentyn PTAL. Some notes:

• I tested this locally, and when I ran my tests using ./gradlew :sdks:python:flinkValidatesRunner --no-parallel the test passed fine. I think the flinkValidatesRunner test overloaded Jenkins memory, which is why the tests gave weird logs. I implemented a code block to force the tests to run sequentially, so now the tests pass.
• I stuck to Mark's proposed Gradle structure, and I used angoenka's suggestion to collaps the code, but to make that work I had to change the location of portableWordCount to also fit into that.
• the tests take a long time to finish. Maybe we should not run these tests on 3.5-3.6?
• I also moved some the py2 tests to /sdks/python/test-suites/portable/py27. Was this too soon (as it's still being discussed on the dev mailing list)?

[fredo838]

Run Python PostCommit

[stale]

This pull request has been marked as stale due to 60 days of inactivity. It will be closed in 1 week if no further activity occurs. If you think that’s incorrect or this pull request requires a review, please simply write any comment. If closed, you can revive the PR at any time and @mention a reviewer or discuss it on the dev@beam.apache.org list. Thank you for your contributions.

[stale]

This pull request has been closed due to lack of activity. If you think that is incorrect, or the pull request requires review, you can revive the PR at any time.