[BEAM-9654] Update Jet Runner to Jet version 4.0

[jbartok]

Hazelcast Jet recently released version 4.0 (https://jet-start.sh/blog/2020/03/02/jet-40-is-released) and this pull request updates Beam's Jet Runner to that version. It also extends the Runners web page with information about the 4.0 version.

---

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

• Choose reviewer(s) and mention them in a comment (R: @username).
• Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
• Update CHANGES.md with noteworthy changes.
• If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang	SDK	Apex	Dataflow	Flink	Gearpump	Samza	Spark
Go		---	---		---	---
Java
Python		---			---	---
XLang	---	---	---		---	---

Pre-Commit Tests Status (on master branch)

---	Java	Python	Go	Website
Non-portable
Portable	---		---	---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

[jbartok]

R: @mxm

[mxm]

Thanks @jbartok. LGTM.

[mxm]

Btw, there doesn't appear to be a Jenkins job (see .test-infra) for running the validates runner or other integration tests. Do you plan to add one?

[jbartok]

Btw, there doesn't appear to be a Jenkins job (see .test-infra) for running the validates runner or other integration tests. Do you plan to add one?

I don't plan to add one, because I'm completely unfamiliar with the whole topic. I do have some Gradle targets in the Jet Runner module to execute @ValidatesRunner & @NeedsRunner tests with it, but that's it. I did check those, just as many pass now as before the upgrade.

[mxm]

I think it would be helpful to compare the jet runner with other runners. If there is already a Gradle target, it is very easy to do. The Jenkins job dsl scripts in .test-infra/jenkins automatically create the Jenkins job. You can see how they work if you just look at the ones for Flink or other runners.

[mxm]

Btw, the JIRA is missing, I've created it here: https://jira.apache.org/jira/browse/BEAM-9654

[jbartok]

Question: the runner's page (https://beam.apache.org/documentation/runners/jet/) has an "Adapt for" button, to change content between Jet 3.0 and Jet 4.0. It worked perfectly in a locally served website, but looks like it doesn't in the deployed one.... Any idea why?

[jbartok]

Yeah, works in the merged in version too, locally, but what ended up deployed is broken... No idea why.

[mxm]

Works for me.

[jbartok]

Yeah, now that I've flushed my browser cash works indeed... Thanks for checking.