[BEAM-10052] check hash and avoid duplicated artifacts

[ihji]

---

Thank you for your contribution! Follow this checklist to help us incorporate your contribution quickly and easily:

• Choose reviewer(s) and mention them in a comment (R: @username).
• Format the pull request title like [BEAM-XXX] Fixes bug in ApproximateQuantiles, where you replace BEAM-XXX with the appropriate JIRA issue, if applicable. This will automatically link the pull request to the issue.
• Update CHANGES.md with noteworthy changes.
• If this contribution is large, please file an Apache Individual Contributor License Agreement.

See the Contributor Guide for more tips on how to make review process smoother.

Post-Commit Tests Status (on master branch)

Lang	SDK	Apex	Dataflow	Flink	Gearpump	Samza	Spark
Go		---	---		---	---
Java
Python		---			---	---
XLang	---	---	---		---	---

Pre-Commit Tests Status (on master branch)

---	Java	Python	Go	Website
Non-portable
Portable	---		---	---

See .test-infra/jenkins/README for trigger phrase, status and link of all Jenkins jobs.

[ihji]

R: @chamikaramj

[chamikaramj]

WDYT about ihji#1 ?
(only change is to Environments.java other changes should go away if you rebase)

[ihji]

WDYT about ihji#1 ?
(only change is to Environments.java other changes should go away if you rebase)

It will add 36 characters + the length of file name. Is there any concern about the maximum length of GCS object name? I think it's okay if GCS allows enough space in object names.

[chamikaramj]

Seems like GCS allows object names up to 1024 bytes - https://cloud.google.com/storage/docs/naming-objects

Agree that it might be good to limit the size of uploaded jars given that we are picking all jars from class path. Possibly we should try to send the actual name along with the artifact proto but that can separate.

[chamikaramj]

LGTM

[chamikaramj]

Retest this please

[chamikaramj]

Retest this please

[chamikaramj]

Retest this please

[chamikaramj]

Retest this please