HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 #6629

ayushtkn · 2024-03-15T10:23:03Z

Description of PR

Drop support for Hbase v1 & Upgrade Hbase v2

How was this patch tested?

Jenikins

For code changes:

Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under ASF 2.0?
If applicable, have you updated the LICENSE, LICENSE-binary, NOTICE-binary files?

steveloughran · 2024-03-28T11:04:35Z

fyi you'll need to update LICENSE-binary too; references hbase 1 artifacts

hadoop-yetus · 2024-03-28T20:18:15Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 20s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	pathlen	0m 0s	/results-pathlen.txt	The patch appears to contain 7 files with names longer than 240
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	17m 7s		Maven dependency ordering for branch
+1 💚	mvninstall	24m 43s		trunk passed
+1 💚	compile	10m 32s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	compile	9m 34s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	checkstyle	2m 27s		trunk passed
+1 💚	mvnsite	14m 13s		trunk passed
+1 💚	javadoc	5m 11s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	5m 10s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 15s		branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+0 🆗	spotbugs	0m 15s		branch/hadoop-assemblies no spotbugs output file (spotbugsXml.xml)
-1 ❌	spotbugs	6m 39s	/branch-spotbugs-hadoop-yarn-project-warnings.html	hadoop-yarn-project in trunk has 1 extant spotbugs warnings.
-1 ❌	spotbugs	19m 6s	/branch-spotbugs-root-warnings.html	root in trunk has 4 extant spotbugs warnings.
+1 💚	shadedclient	25m 5s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	1m 26s		Maven dependency ordering for patch
+1 💚	mvninstall	27m 12s		the patch passed
+1 💚	compile	9m 56s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javac	9m 56s		the patch passed
+1 💚	compile	9m 28s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	javac	9m 28s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	2m 32s		the patch passed
+1 💚	mvnsite	12m 54s		the patch passed
+1 💚	javadoc	4m 47s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	5m 26s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 14s		hadoop-project has no data from spotbugs
+0 🆗	spotbugs	0m 15s		hadoop-assemblies has no data from spotbugs
+1 💚	shadedclient	21m 50s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	672m 21s	/patch-unit-root.txt	root in the patch passed.
-1 ❌	asflicense	1m 5s	/results-asflicense.txt	The patch generated 10 ASF License warnings.
		957m 33s

Reason	Tests
Failed junit tests	hadoop.yarn.server.timelineservice.security.TestTimelineAuthFilterForV2
	hadoop.hdfs.server.federation.router.TestRouterRpcMultiDestination
	hadoop.hdfs.server.datanode.TestDirectoryScanner
	hadoop.hdfs.TestReconstructStripedFile

Subsystem	Report/Notes
Docker	ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/11/artifact/out/Dockerfile
GITHUB PR	#6629
Optional Tests	dupname asflicense codespell detsecrets compile javac javadoc mvninstall mvnsite unit shadedclient xmllint spotbugs checkstyle
uname	Linux ceb2bef161da 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `6016798`
Default Java	Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/11/testReport/
Max. process+thread count	4516 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2 . hadoop-yarn-project hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/11/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

ayushtkn · 2024-03-30T06:04:59Z

Thanx I have update the LICENSE-binary file, the Jenkins warnings aren't related to my change. I will track them separately

hadoop-yetus · 2024-03-31T03:22:03Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 50s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	pathlen	0m 0s	/results-pathlen.txt	The patch appears to contain 7 files with names longer than 240
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	14m 11s		Maven dependency ordering for branch
+1 💚	mvninstall	37m 23s		trunk passed
+1 💚	compile	19m 27s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	compile	18m 52s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	checkstyle	4m 51s		trunk passed
+1 💚	mvnsite	21m 57s		trunk passed
+1 💚	javadoc	8m 59s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	7m 52s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 19s		branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+0 🆗	spotbugs	0m 20s		branch/hadoop-assemblies no spotbugs output file (spotbugsXml.xml)
-1 ❌	spotbugs	11m 14s	/branch-spotbugs-hadoop-yarn-project-warnings.html	hadoop-yarn-project in trunk has 1 extant spotbugs warnings.
-1 ❌	spotbugs	32m 29s	/branch-spotbugs-root-warnings.html	root in trunk has 4 extant spotbugs warnings.
+1 💚	shadedclient	39m 54s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	1m 32s		Maven dependency ordering for patch
+1 💚	mvninstall	42m 55s		the patch passed
+1 💚	compile	19m 6s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javac	19m 6s		the patch passed
+1 💚	compile	17m 40s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	javac	17m 40s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	4m 40s		the patch passed
+1 💚	mvnsite	19m 54s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	8m 58s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	7m 55s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 19s		hadoop-project has no data from spotbugs
+0 🆗	spotbugs	0m 20s		hadoop-assemblies has no data from spotbugs
+1 💚	shadedclient	38m 51s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	818m 53s		root in the patch passed.
-1 ❌	asflicense	1m 39s	/results-asflicense.txt	The patch generated 10 ASF License warnings.
		1277m 44s

Subsystem	Report/Notes
Docker	ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/13/artifact/out/Dockerfile
GITHUB PR	#6629
Optional Tests	dupname asflicense codespell detsecrets compile javac javadoc mvninstall mvnsite unit shadedclient xmllint spotbugs checkstyle shellcheck shelldocs
uname	Linux 1594e76fd6b8 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `f7c8d40`
Default Java	Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/13/testReport/
Max. process+thread count	3510 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2 . hadoop-yarn-project hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/13/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

steveloughran · 2024-04-03T17:29:53Z

license warnings are due to vm crash logs

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3867936.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3868115.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3868361.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3867814.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3867303.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3867431.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3868488.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3868239.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3867556.log:1:Missing Apache License
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/hs_err_pid3867692.log:1:Missing Apache License

something not launching right?

ayushtkn · 2024-04-03T18:05:53Z

The license thing was was green till here:
#6629 (comment)

But in this I fixed a RBF build failure, considering it broke by my changes, later it got committed separately, so I had to rebase & force-push same changes + changes in LICENSE & building.txt file. I don’t think it is related to patch. I will rebase again & see

hadoop-yetus · 2024-04-04T15:33:57Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 50s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+0 🆗	shelldocs	0m 0s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	pathlen	0m 0s	/results-pathlen.txt	The patch appears to contain 7 files with names longer than 240
+1 💚	test4tests	0m 0s		The patch appears to include 1 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	14m 46s		Maven dependency ordering for branch
+1 💚	mvninstall	38m 16s		trunk passed
+1 💚	compile	19m 52s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	compile	18m 29s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	checkstyle	4m 49s		trunk passed
+1 💚	mvnsite	23m 4s		trunk passed
+1 💚	javadoc	9m 7s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	7m 50s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 20s		branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+0 🆗	spotbugs	0m 19s		branch/hadoop-assemblies no spotbugs output file (spotbugsXml.xml)
-1 ❌	spotbugs	11m 11s	/branch-spotbugs-hadoop-yarn-project-warnings.html	hadoop-yarn-project in trunk has 1 extant spotbugs warnings.
-1 ❌	spotbugs	32m 21s	/branch-spotbugs-root-warnings.html	root in trunk has 4 extant spotbugs warnings.
+1 💚	shadedclient	40m 7s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	1m 38s		Maven dependency ordering for patch
+1 💚	mvninstall	43m 14s		the patch passed
+1 💚	compile	19m 23s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javac	19m 23s		the patch passed
+1 💚	compile	17m 58s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	javac	17m 58s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	4m 42s		the patch passed
+1 💚	mvnsite	20m 53s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	9m 37s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	7m 57s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 19s		hadoop-project has no data from spotbugs
+0 🆗	spotbugs	0m 19s		hadoop-assemblies has no data from spotbugs
+1 💚	shadedclient	39m 47s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	818m 19s		root in the patch passed.
-1 ❌	asflicense	1m 40s	/results-asflicense.txt	The patch generated 10 ASF License warnings.
		1284m 34s

Subsystem	Report/Notes
Docker	ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/14/artifact/out/Dockerfile
GITHUB PR	#6629
Optional Tests	dupname asflicense codespell detsecrets compile javac javadoc mvninstall mvnsite unit shadedclient xmllint spotbugs checkstyle shellcheck shelldocs
uname	Linux 4ab59b7a681f 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `333bbd5`
Default Java	Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/14/testReport/
Max. process+thread count	3392 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2 . hadoop-yarn-project hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/14/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

steveloughran · 2024-04-05T13:01:03Z

looks like some launched process is crashing leaving a .log file...

ayushtkn · 2024-04-05T15:03:24Z

vm-crash.txt
Thanx @steveloughran, Spent some time checking for the reasons, yes there is a crash. I have attached the snippet from the Jenkins output, which shows the crash.

This test doesn't create issues locally though, I will find some time & explore what could be a potential fix

…iling with NoClassDefFoundError. Contributed by Sushil Ks." This reverts commit eeaf8ed.

ayushtkn · 2024-04-09T15:25:16Z

Spent some time over the weekend to investigate this, findings so far

This doesn’t fail locally, only on Jenkins.
Created a Test PR to investigate on Jenkins, Disabled Forking to find the failing test
The failing test was: TestTimelineReaderWebServicesHBaseStorage
Reason: It uses some jmockit dependency which was creating troubles like: NoSuchFieldError: $MB
Quick Search over the internet said upgrading this dependency will fix this.
Tried upgrading but upgrading this jmockit requires passing the javaagent kind of stuff now, else it doesn’t work. It is there on their website.(https://jmockit.github.io/)
This approach Failed
Exp:-2
Investigating further. I found it was introduced as part of YARN-8856, which added this because HBase was using a lower Hadoop version then, but this problem should be sorted by this upgrade.
Reverted the YARN ticket. The test passes. But the VM still crashed. WT*
Searching over the internet again: Found this: https://stackoverflow.com/a/70985786/13998537 , which said about Fork Value.
This works.
I have a green run, but with slightly different fix, (not ditching the DummyMetrics, Which I think we can do now) here: Test PR: Test Jenkins. (WIP) #6707 (comment) , So, if the current PR doesn’t get me a green build, I can go back to that.

TLDR: If we get a green build, We are sorted, Else I have another fix as well. Which has already given me a green build on my Test PR, I will investigate more over the weekend & move to it if this one fails.

hadoop-yetus · 2024-04-10T06:46:09Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	8m 9s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+0 🆗	shelldocs	0m 0s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	pathlen	0m 0s	/results-pathlen.txt	The patch appears to contain 7 files with names longer than 240
+1 💚	test4tests	0m 0s		The patch appears to include 3 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	14m 25s		Maven dependency ordering for branch
+1 💚	mvninstall	20m 6s		trunk passed
+1 💚	compile	8m 58s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	compile	8m 18s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	checkstyle	2m 6s		trunk passed
+1 💚	mvnsite	13m 43s		trunk passed
+1 💚	javadoc	4m 54s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	5m 10s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 14s		branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+0 🆗	spotbugs	0m 13s		branch/hadoop-assemblies no spotbugs output file (spotbugsXml.xml)
-1 ❌	spotbugs	6m 13s	/branch-spotbugs-hadoop-yarn-project-warnings.html	hadoop-yarn-project in trunk has 1 extant spotbugs warnings.
-1 ❌	spotbugs	17m 32s	/branch-spotbugs-root-warnings.html	root in trunk has 4 extant spotbugs warnings.
+1 💚	shadedclient	21m 17s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	1m 26s		Maven dependency ordering for patch
+1 💚	mvninstall	21m 56s		the patch passed
+1 💚	compile	8m 45s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javac	8m 45s		the patch passed
+1 💚	compile	8m 21s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	javac	8m 21s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	2m 9s		the patch passed
+1 💚	mvnsite	11m 13s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	4m 48s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	5m 11s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 15s		hadoop-project has no data from spotbugs
+0 🆗	spotbugs	0m 15s		hadoop-assemblies has no data from spotbugs
+1 💚	shadedclient	20m 17s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	676m 15s	/patch-unit-root.txt	root in the patch passed.
+1 💚	asflicense	1m 4s		The patch does not generate ASF License warnings.
		937m 38s

Reason	Tests
Failed junit tests	hadoop.yarn.server.resourcemanager.reservation.TestCapacityOverTimePolicy
	hadoop.hdfs.server.balancer.TestBalancer

Subsystem	Report/Notes
Docker	ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/18/artifact/out/Dockerfile
GITHUB PR	#6629
Optional Tests	dupname asflicense codespell detsecrets compile javac javadoc mvninstall mvnsite unit shadedclient xmllint spotbugs checkstyle shellcheck shelldocs
uname	Linux 8734d0c80d35 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `ef2f7c9`
Default Java	Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/18/testReport/
Max. process+thread count	4064 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2 . hadoop-yarn-project hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/18/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

ayushtkn · 2024-04-10T10:14:45Z

The test failures doesn't look related. With same change on my Test PR different tests failed, the VM crashing and stuff is sorted, ASF License is green.

vinayakumarb · 2024-04-15T18:58:39Z

...erver-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2/pom.xml

@@ -27,22 +27,14 @@
  <modelVersion>4.0.0</modelVersion>

  <artifactId>hadoop-yarn-server-timelineservice-hbase-server-2</artifactId>
-  <name>Apache Hadoop YARN TimelineService HBase Server 2.2</name>
+  <name>Apache Hadoop YARN TimelineService HBase Server 2.5.8</name>


better to keep as 2.5?

hadoop-yetus · 2024-04-16T18:05:40Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	0m 50s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 0s		No case conflicting files found.
+0 🆗	codespell	0m 0s		codespell was not available.
+0 🆗	detsecrets	0m 0s		detect-secrets was not available.
+0 🆗	xmllint	0m 1s		xmllint was not available.
+0 🆗	shelldocs	0m 1s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	pathlen	0m 0s	/results-pathlen.txt	The patch appears to contain 7 files with names longer than 240
+1 💚	test4tests	0m 0s		The patch appears to include 3 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	14m 39s		Maven dependency ordering for branch
+1 💚	mvninstall	37m 0s		trunk passed
+1 💚	compile	19m 39s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	compile	18m 13s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	checkstyle	4m 49s		trunk passed
+1 💚	mvnsite	22m 59s		trunk passed
+1 💚	javadoc	9m 7s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	7m 55s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 19s		branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+0 🆗	spotbugs	0m 20s		branch/hadoop-assemblies no spotbugs output file (spotbugsXml.xml)
-1 ❌	spotbugs	11m 21s	/branch-spotbugs-hadoop-yarn-project-warnings.html	hadoop-yarn-project in trunk has 1 extant spotbugs warnings.
-1 ❌	spotbugs	32m 16s	/branch-spotbugs-root-warnings.html	root in trunk has 3 extant spotbugs warnings.
+1 💚	shadedclient	39m 54s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	2m 3s		Maven dependency ordering for patch
+1 💚	mvninstall	43m 2s		the patch passed
+1 💚	compile	19m 7s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javac	19m 7s		the patch passed
+1 💚	compile	17m 59s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	javac	17m 59s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	4m 45s		the patch passed
+1 💚	mvnsite	21m 12s		the patch passed
+1 💚	shellcheck	0m 1s		No new issues.
+1 💚	javadoc	9m 1s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	7m 51s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 20s		hadoop-project has no data from spotbugs
+0 🆗	spotbugs	0m 20s		hadoop-assemblies has no data from spotbugs
+1 💚	shadedclient	39m 15s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
+1 💚	unit	829m 30s		root in the patch passed.
+1 💚	asflicense	1m 44s		The patch does not generate ASF License warnings.
		1291m 17s

Subsystem	Report/Notes
Docker	ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/19/artifact/out/Dockerfile
GITHUB PR	#6629
Optional Tests	dupname asflicense codespell detsecrets compile javac javadoc mvninstall mvnsite unit shadedclient xmllint spotbugs checkstyle shellcheck shelldocs
uname	Linux 0747a2122926 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `1b1d81b`
Default Java	Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/19/testReport/
Max. process+thread count	3366 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2 . hadoop-yarn-project hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/19/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

steveloughran

wow, this is painful. I am not a fan of mocking from a maintenance perspective. you can do powerful things w.r.t fault injection, it's just so brittle.

be good once this is done though

...roject/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/pom.xml

hadoop-yetus · 2024-04-17T19:30:09Z

💔 -1 overall

Vote	Subsystem	Runtime	Logfile	Comment
+0 🆗	reexec	18m 7s		Docker mode activated.
			_ Prechecks _
+1 💚	dupname	0m 1s		No case conflicting files found.
+0 🆗	codespell	0m 1s		codespell was not available.
+0 🆗	detsecrets	0m 1s		detect-secrets was not available.
+0 🆗	xmllint	0m 0s		xmllint was not available.
+0 🆗	shelldocs	0m 0s		Shelldocs was not available.
+1 💚	@author	0m 0s		The patch does not contain any @author tags.
-1 ❌	pathlen	0m 0s	/results-pathlen.txt	The patch appears to contain 7 files with names longer than 240
+1 💚	test4tests	0m 0s		The patch appears to include 3 new or modified test files.
			_ trunk Compile Tests _
+0 🆗	mvndep	14m 39s		Maven dependency ordering for branch
+1 💚	mvninstall	36m 33s		trunk passed
+1 💚	compile	19m 43s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	compile	18m 54s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	checkstyle	4m 44s		trunk passed
+1 💚	mvnsite	23m 18s		trunk passed
+1 💚	javadoc	9m 43s		trunk passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	7m 55s		trunk passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 20s		branch/hadoop-project no spotbugs output file (spotbugsXml.xml)
+0 🆗	spotbugs	0m 19s		branch/hadoop-assemblies no spotbugs output file (spotbugsXml.xml)
-1 ❌	spotbugs	11m 19s	/branch-spotbugs-hadoop-yarn-project-warnings.html	hadoop-yarn-project in trunk has 1 extant spotbugs warnings.
-1 ❌	spotbugs	32m 34s	/branch-spotbugs-root-warnings.html	root in trunk has 3 extant spotbugs warnings.
+1 💚	shadedclient	40m 6s		branch has no errors when building and testing our client artifacts.
			_ Patch Compile Tests _
+0 🆗	mvndep	1m 38s		Maven dependency ordering for patch
+1 💚	mvninstall	42m 28s		the patch passed
+1 💚	compile	19m 48s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javac	19m 48s		the patch passed
+1 💚	compile	18m 41s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+1 💚	javac	18m 41s		the patch passed
+1 💚	blanks	0m 0s		The patch has no blanks issues.
+1 💚	checkstyle	4m 41s		the patch passed
+1 💚	mvnsite	21m 32s		the patch passed
+1 💚	shellcheck	0m 0s		No new issues.
+1 💚	javadoc	9m 6s		the patch passed with JDK Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1
+1 💚	javadoc	8m 4s		the patch passed with JDK Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
+0 🆗	spotbugs	0m 20s		hadoop-project has no data from spotbugs
+0 🆗	spotbugs	0m 18s		hadoop-assemblies has no data from spotbugs
+1 💚	shadedclient	39m 2s		patch has no errors when building and testing our client artifacts.
			_ Other Tests _
-1 ❌	unit	828m 7s	/patch-unit-root.txt	root in the patch passed.
+1 💚	asflicense	1m 41s		The patch does not generate ASF License warnings.
		1311m 50s

Reason	Tests
Failed junit tests	hadoop.hdfs.TestRollingUpgrade

Subsystem	Report/Notes
Docker	ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/20/artifact/out/Dockerfile
GITHUB PR	#6629
Optional Tests	dupname asflicense codespell detsecrets compile javac javadoc mvninstall mvnsite unit shadedclient xmllint spotbugs checkstyle shellcheck shelldocs
uname	Linux 3cd6cc4d0717 5.15.0-94-generic #104-Ubuntu SMP Tue Jan 9 15:25:40 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/bin/hadoop.sh
git revision	trunk / `68c8b06`
Default Java	Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Multi-JDK versions	/usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.22+7-post-Ubuntu-0ubuntu220.04.1 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_402-8u402-ga-2ubuntu1~20.04-b06
Test Results	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/20/testReport/
Max. process+thread count	3406 (vs. ulimit of 5500)
modules	C: hadoop-project hadoop-assemblies hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-common hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-client hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-2 . hadoop-yarn-project hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests U: .
Console output	https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-6629/20/console
versions	git=2.25.1 maven=3.6.3 spotbugs=4.2.2 shellcheck=0.7.0
Powered by	Apache Yetus 0.14.0 https://yetus.apache.org

This message was automatically generated.

ayushtkn · 2024-04-17T19:51:19Z

The test failure isn't related, We already have HDFS-17224 for that test, though that mentions only one test from that class, but it is the same thing.

I can trigger the build again to get a green build, if required

steveloughran · 2024-04-19T17:55:49Z

whats up with pathlen? some relic of windows API era? does it still cause problems?

ayushtkn · 2024-04-19T18:10:17Z

Not sure what is the reason for having this, but should be Windows thing I believe, our Building.txt talks about path in case of Windows
https://github.com/apache/hadoop/blob/trunk/BUILDING.txt#L590-L591

But in current context, It is talking about the files I deleted. Since I dropped the entire HBase v1 module

hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/common/HBaseTimelineServerUtils.java:1:path size 1
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/common/package-info.java:1:path size 2
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowRunCoprocessor.java:1:path size 3
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowScanner.java:1:path size 4
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/FlowScannerOperation.java:1:path size 5
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/flow/package-info.java:1:path size 6
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase/hadoop-yarn-server-timelineservice-hbase-server/hadoop-yarn-server-timelineservice-hbase-server-1/src/main/java/org/apache/hadoop/yarn/server/timelineservice/storage/package-info.java:1:path size 7

The names have hadoop-yarn-server-timelineservice-hbase-server-1, since I touched those files, it is flagging my patch has a file refrenced which has a pathlen greater than 240

This module itself we deleted here

This is the link from our daily build for pathlen, you can check all these files are there
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/1563/artifact/out/results-pathlen.txt

You can try searching hadoop-yarn-server-timelineservice-hbase-server-1, it will show 7, exactly the same number here, I didn't rename/add any java file as part of this PR itself

steveloughran

+1 from me then; we will see if anything blows up

…). Contributed by Ayush Saxena

github-actions bot added YARN build trunk labels Mar 15, 2024

This comment was marked as outdated.

Sign in to view

ayushtkn closed this Mar 17, 2024

ayushtkn reopened this Mar 17, 2024

github-actions bot added HDFS RBF labels Mar 17, 2024

This comment was marked as outdated.

Sign in to view

ayushtkn changed the title ~~WIP~~ HADOOP-19107: Drop support for HBase v1 & upgrade HBase v2 Mar 19, 2024

ayushtkn changed the title ~~HADOOP-19107: Drop support for HBase v1 & upgrade HBase v2~~ HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 Mar 19, 2024

This comment was marked as outdated.

Sign in to view

apache deleted a comment from hadoop-yetus Mar 20, 2024

ayushtkn force-pushed the HADOOP-19107 branch from 60ccdff to 6016798 Compare March 28, 2024 04:19

github-actions bot removed HDFS RBF labels Mar 28, 2024

This comment was marked as outdated.

Sign in to view

ayushtkn force-pushed the HADOOP-19107 branch from f7c8d40 to 333bbd5 Compare April 3, 2024 18:07

ayushtkn force-pushed the HADOOP-19107 branch from 333bbd5 to 8aa3e60 Compare April 9, 2024 12:47

Upgrade HBase.

5971e5e

ayushtkn force-pushed the HADOOP-19107 branch from 8aa3e60 to 51b10ab Compare April 9, 2024 12:50

apache deleted a comment from hadoop-yetus Apr 9, 2024

ayushtkn added 2 commits April 9, 2024 20:34

Revert "YARN-8856. TestTimelineReaderWebServicesHBaseStorage tests fa…

03985c7

…iling with NoClassDefFoundError. Contributed by Sushil Ks." This reverts commit eeaf8ed.

Disable Forking to avoid the crash

ef2f7c9

ayushtkn force-pushed the HADOOP-19107 branch from 51b10ab to ef2f7c9 Compare April 9, 2024 15:07

vinayakumarb reviewed Apr 15, 2024

View reviewed changes

vinayakumarb approved these changes Apr 15, 2024

View reviewed changes

Change name from 2.5.8 to 2.5

1b1d81b

steveloughran requested changes Apr 16, 2024

View reviewed changes

...roject/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-timelineservice-hbase-tests/pom.xml Show resolved Hide resolved

Add a comment.

68c8b06

steveloughran approved these changes Apr 22, 2024

View reviewed changes

ayushtkn merged commit eec9cd2 into apache:trunk Apr 22, 2024
1 of 6 checks passed

CCweixiao pushed a commit to CCweixiao/hadoop that referenced this pull request May 4, 2024

HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 (apache#6629…

22881b7

…). Contributed by Ayush Saxena

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 #6629

HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 #6629

ayushtkn commented Mar 15, 2024 •

edited

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

steveloughran commented Mar 28, 2024

hadoop-yetus commented Mar 28, 2024

This comment was marked as outdated.

ayushtkn commented Mar 30, 2024

hadoop-yetus commented Mar 31, 2024

steveloughran commented Apr 3, 2024

ayushtkn commented Apr 3, 2024

hadoop-yetus commented Apr 4, 2024

steveloughran commented Apr 5, 2024

ayushtkn commented Apr 5, 2024

ayushtkn commented Apr 9, 2024

hadoop-yetus commented Apr 10, 2024

ayushtkn commented Apr 10, 2024 •

edited

vinayakumarb Apr 15, 2024

ayushtkn Apr 16, 2024

hadoop-yetus commented Apr 16, 2024

steveloughran left a comment

hadoop-yetus commented Apr 17, 2024

ayushtkn commented Apr 17, 2024

steveloughran commented Apr 19, 2024

ayushtkn commented Apr 19, 2024 •

edited

steveloughran left a comment

HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 #6629

HADOOP-19107. Drop support for HBase v1 & upgrade HBase v2 #6629

Conversation

ayushtkn commented Mar 15, 2024 • edited

Description of PR

How was this patch tested?

For code changes:

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

This comment was marked as outdated.

steveloughran commented Mar 28, 2024

hadoop-yetus commented Mar 28, 2024

This comment was marked as outdated.

ayushtkn commented Mar 30, 2024

hadoop-yetus commented Mar 31, 2024

steveloughran commented Apr 3, 2024

ayushtkn commented Apr 3, 2024

hadoop-yetus commented Apr 4, 2024

steveloughran commented Apr 5, 2024

ayushtkn commented Apr 5, 2024

ayushtkn commented Apr 9, 2024

hadoop-yetus commented Apr 10, 2024

ayushtkn commented Apr 10, 2024 • edited

vinayakumarb Apr 15, 2024

Choose a reason for hiding this comment

ayushtkn Apr 16, 2024

Choose a reason for hiding this comment

hadoop-yetus commented Apr 16, 2024

steveloughran left a comment

Choose a reason for hiding this comment

hadoop-yetus commented Apr 17, 2024

ayushtkn commented Apr 17, 2024

steveloughran commented Apr 19, 2024

ayushtkn commented Apr 19, 2024 • edited

steveloughran left a comment

Choose a reason for hiding this comment

ayushtkn commented Mar 15, 2024 •

edited

ayushtkn commented Apr 10, 2024 •

edited

ayushtkn commented Apr 19, 2024 •

edited