HADOOP-18496: upgrade kotlin and okhttp3 due to kotlin CVEs #5035

pjfanning · 2022-10-15T18:47:42Z

Description of PR

HADOOP-18496 - the version of kotlin-stdlib currently is in use has CVEs. kotlin-stdlib is only needed because of okhttp - but it needs to be upgraded due to kotlin-stdlib upgrade

How was this patch tested?

For code changes:

Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

hadoop-yetus · 2022-10-16T16:14:40Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 54s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ trunk Compile Tests _
+0 🆗	mvndep	16m 4s		Maven dependency ordering for branch
+1 💚	mvninstall	28m 49s		trunk passed
+1 💚	compile	25m 34s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	compile	22m 10s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	mvnsite	20m 26s		trunk passed
+1 💚	javadoc	8m 33s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 30s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	38m 51s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 36s		Maven dependency ordering for patch
-1 ❌	mvninstall	1m 34s	/patch-mvninstall-root.txt	root in the patch failed.
+1 💚	compile	24m 59s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javac	24m 59s		the patch passed
+1 💚	compile	22m 10s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
-1 ❌	javac	22m 10s	/results-compile-javac-root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07.txt	root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 generated 1 new + 2610 unchanged - 6 fixed = 2611 total (was 2616)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	19m 57s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	8m 19s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 32s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
-1 ❌	shadedclient	21m 10s		patch has errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	1037m 1s	/patch-unit-root.txt	root in the patch passed.
+1 💚	asflicense	2m 1s		The patch does not generate ASF License warnings.
		1285m 32s

Reason	Tests
Failed junit tests	hadoop.mapreduce.v2.app.TestRuntimeEstimators
	hadoop.hdfs.server.federation.router.TestRouterRPCMultipleDestinationMountTableResolver

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/1/artifact/out/Dockerfile
GITHUB PR	#5035
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint shellcheck shelldocs
uname	Linux c9aa69fd7b27 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `75a2757`
Default Java	Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/1/testReport/
Max. process+thread count	3474 (vs. ulimit of 5500)
modules	C: hadoop-project . U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/1/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2022-10-17T15:16:27Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 54s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ trunk Compile Tests _
+0 🆗	mvndep	15m 36s		Maven dependency ordering for branch
+1 💚	mvninstall	28m 37s		trunk passed
+1 💚	compile	25m 20s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	compile	21m 57s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	mvnsite	20m 25s		trunk passed
+1 💚	javadoc	8m 28s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 36s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	38m 36s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 36s		Maven dependency ordering for patch
-1 ❌	mvninstall	1m 4s	/patch-mvninstall-hadoop-common-project_hadoop-common.txt	hadoop-common in the patch failed.
-1 ❌	mvninstall	1m 31s	/patch-mvninstall-root.txt	root in the patch failed.
+1 💚	compile	24m 53s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javac	24m 53s		the patch passed
+1 💚	compile	22m 16s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
-1 ❌	javac	22m 16s	/results-compile-javac-root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07.txt	root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 generated 1 new + 2610 unchanged - 6 fixed = 2611 total (was 2616)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	20m 2s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	8m 19s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 33s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
-1 ❌	shadedclient	21m 6s		patch has errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	1066m 2s	/patch-unit-root.txt	root in the patch passed.
+1 💚	asflicense	1m 54s		The patch does not generate ASF License warnings.
		1315m 0s

Reason	Tests
Failed junit tests	hadoop.mapreduce.v2.app.TestRuntimeEstimators

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/2/artifact/out/Dockerfile
GITHUB PR	#5035
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint shellcheck shelldocs
uname	Linux c2272a4d4904 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `7368a93`
Default Java	Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/2/testReport/
Max. process+thread count	4648 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client . U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/2/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2022-10-18T15:18:25Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 54s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ trunk Compile Tests _
+0 🆗	mvndep	16m 3s		Maven dependency ordering for branch
+1 💚	mvninstall	28m 52s		trunk passed
+1 💚	compile	25m 35s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	compile	22m 11s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	mvnsite	20m 21s		trunk passed
+1 💚	javadoc	8m 34s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 30s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	39m 3s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 32s		Maven dependency ordering for patch
-1 ❌	mvninstall	25m 5s	/patch-mvninstall-root.txt	root in the patch failed.
+1 💚	compile	24m 57s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javac	24m 57s		the patch passed
+1 💚	compile	22m 16s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
-1 ❌	javac	22m 16s	/results-compile-javac-root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07.txt	root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 generated 1 new + 2610 unchanged - 6 fixed = 2611 total (was 2616)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	20m 6s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	8m 19s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 27s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
-1 ❌	shadedclient	40m 4s		patch has errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	1045m 21s	/patch-unit-root.txt	root in the patch passed.
+1 💚	asflicense	2m 13s		The patch does not generate ASF License warnings.
		1338m 48s

Reason	Tests
Failed junit tests	hadoop.mapreduce.v2.app.TestRuntimeEstimators

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/3/artifact/out/Dockerfile
GITHUB PR	#5035
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint shellcheck shelldocs
uname	Linux 9d2a96d70ebd 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `02a1f29`
Default Java	Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/3/testReport/
Max. process+thread count	3576 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client . U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/3/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

hadoop-yetus · 2022-10-21T18:45:28Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 56s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ trunk Compile Tests _
+0 🆗	mvndep	15m 37s		Maven dependency ordering for branch
+1 💚	mvninstall	28m 48s		trunk passed
+1 💚	compile	25m 37s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	compile	22m 7s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	mvnsite	20m 33s		trunk passed
+1 💚	javadoc	8m 33s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 32s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	38m 42s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 37s		Maven dependency ordering for patch
+1 💚	mvninstall	30m 51s		the patch passed
+1 💚	compile	24m 56s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javac	24m 56s		the patch passed
+1 💚	compile	22m 10s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
-1 ❌	javac	22m 10s	/results-compile-javac-root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07.txt	root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 generated 1 new + 2610 unchanged - 6 fixed = 2611 total (was 2616)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	20m 9s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	8m 47s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 32s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	40m 38s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	1077m 45s	/patch-unit-root.txt	root in the patch passed.
+1 💚	asflicense	2m 1s		The patch does not generate ASF License warnings.
		1374m 34s

Reason	Tests
Failed junit tests	hadoop.mapreduce.v2.app.TestRuntimeEstimators

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/6/artifact/out/Dockerfile
GITHUB PR	#5035
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint shellcheck shelldocs
uname	Linux 19d6e353dd10 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `1fa6f53`
Default Java	Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/6/testReport/
Max. process+thread count	4664 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-client-modules/hadoop-client-runtime . U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/6/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

pjfanning · 2022-10-21T19:54:19Z

TestRuntimeEstimators runs ok on my laptop

LICENSE-binary

hadoop-common-project/hadoop-common/pom.xml

dependency conflict kotlin dep convergence issue Update pom.xml

steveloughran

+1 pending a happy yetus

hadoop-yetus · 2022-11-01T20:51:07Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	1m 3s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	test4tests	0m 0s		The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
			_ trunk Compile Tests _
+0 🆗	mvndep	15m 22s		Maven dependency ordering for branch
+1 💚	mvninstall	28m 44s		trunk passed
+1 💚	compile	25m 38s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	compile	22m 18s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	mvnsite	20m 46s		trunk passed
+1 💚	javadoc	8m 55s		trunk passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	7m 30s		trunk passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	38m 50s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	0m 35s		Maven dependency ordering for patch
+1 💚	mvninstall	31m 17s		the patch passed
+1 💚	compile	25m 0s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javac	25m 0s		the patch passed
+1 💚	compile	23m 6s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
-1 ❌	javac	23m 6s	/results-compile-javac-root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07.txt	root-jdkPrivateBuild-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~~20.04-b07 generated 5 new + 2612 unchanged - 1 fixed = 2617 total (was 2613)
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	mvnsite	21m 40s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	9m 1s		the patch passed with JDK Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04
+1 💚	javadoc	8m 33s		the patch passed with JDK Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
+1 💚	shadedclient	42m 25s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	1042m 31s	/patch-unit-root.txt	root in the patch passed.
+1 💚	asflicense	1m 52s		The patch does not generate ASF License warnings.
		1344m 7s

Reason	Tests
Failed junit tests	hadoop.fs.http.client.TestHttpFSFWithWebhdfsFileSystem

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/7/artifact/out/Dockerfile
GITHUB PR	#5035
Optional Tests	dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint shellcheck shelldocs
uname	Linux 52d2d834e882 4.15.0-191-generic #202-Ubuntu SMP Thu Aug 4 01:49:29 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `601f174`
Default Java	Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.16+8-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_342-8u342-b07-0ubuntu1~20.04-b07
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/7/testReport/
Max. process+thread count	3428 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs-client hadoop-client-modules/hadoop-client-runtime . U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-5035/7/console
versions	git=2.25.1 maven=3.6.3 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

pjfanning · 2022-11-02T14:42:16Z

@steveloughran the Yetus results look ok. I can't find anything significant in the logs. The TestHttpFSFWithWebhdfsFileSystem test failure looks like an intermittent issue (a port already in use issue).

steveloughran · 2022-11-12T14:07:14Z

yeah, looks like some jvm state thing; they happen. shouldn't, but they do and are hard to track down/eliminate

+1, merging

steveloughran · 2022-11-12T14:14:52Z

in trunk...lets push through the backport chain as far as we can

…ache#5035) Updates okhttp3 and okio so their transitive dependency on Kotlin stdlib is free from recent CVEs. okhttp3:okhttp => 4.10.0 okio:okio => 3.2.0 kotlin stdlib => 1.6.20 kotlin CVEs fixed: CVE-2022-24329 CVE-2020-29582 Contributed by PJ Fanning.

) Updates okhttp3 and okio so their transitive dependency on Kotlin stdlib is free from recent CVEs. okhttp3:okhttp => 4.10.0 okio:okio => 3.2.0 kotlin stdlib => 1.6.20 kotlin CVEs fixed: CVE-2022-24329 CVE-2020-29582 Contributed by PJ Fanning.

pjfanning force-pushed the HADOOP-18496-kotlin branch from 02a1f29 to 1695948 Compare October 18, 2022 16:24

pjfanning marked this pull request as draft October 20, 2022 17:36

pjfanning force-pushed the HADOOP-18496-kotlin branch from 0d81454 to 1fa6f53 Compare October 20, 2022 19:49

pjfanning marked this pull request as ready for review October 21, 2022 19:36

steveloughran reviewed Oct 31, 2022

View reviewed changes

LICENSE-binary Show resolved Hide resolved

hadoop-common-project/hadoop-common/pom.xml Outdated Show resolved Hide resolved

pjfanning added 2 commits October 31, 2022 22:10

HADOOP-18496: upgrade kotlin and okhttp3 due to kotlin CVEs

269934c

dependency conflict kotlin dep convergence issue Update pom.xml

review comments

601f174

pjfanning force-pushed the HADOOP-18496-kotlin branch from 1fa6f53 to 601f174 Compare October 31, 2022 22:25

steveloughran approved these changes Nov 1, 2022

View reviewed changes

steveloughran approved these changes Nov 12, 2022

View reviewed changes

steveloughran merged commit d340c4a into apache:trunk Nov 12, 2022

pjfanning deleted the HADOOP-18496-kotlin branch November 16, 2022 13:41

pjfanning mentioned this pull request Nov 16, 2022

HADOOP-18496. Upgrade okhttp3 and dependencies due to kotlin CVEs #5139

Closed

4 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HADOOP-18496: upgrade kotlin and okhttp3 due to kotlin CVEs #5035

HADOOP-18496: upgrade kotlin and okhttp3 due to kotlin CVEs #5035

pjfanning commented Oct 15, 2022 •

edited

hadoop-yetus commented Oct 16, 2022

hadoop-yetus commented Oct 17, 2022

hadoop-yetus commented Oct 18, 2022

hadoop-yetus commented Oct 21, 2022

pjfanning commented Oct 21, 2022

steveloughran left a comment

hadoop-yetus commented Nov 1, 2022

pjfanning commented Nov 2, 2022

steveloughran commented Nov 12, 2022

steveloughran commented Nov 12, 2022

HADOOP-18496: upgrade kotlin and okhttp3 due to kotlin CVEs #5035

HADOOP-18496: upgrade kotlin and okhttp3 due to kotlin CVEs #5035

Conversation

pjfanning commented Oct 15, 2022 • edited

Description of PR

How was this patch tested?

For code changes:

hadoop-yetus commented Oct 16, 2022

hadoop-yetus commented Oct 17, 2022

hadoop-yetus commented Oct 18, 2022

hadoop-yetus commented Oct 21, 2022

pjfanning commented Oct 21, 2022

steveloughran left a comment

Choose a reason for hiding this comment

hadoop-yetus commented Nov 1, 2022

pjfanning commented Nov 2, 2022

steveloughran commented Nov 12, 2022

steveloughran commented Nov 12, 2022

pjfanning commented Oct 15, 2022 •

edited