HBASE-26590 Hbase-client Meta lookup performance regression between h… #4008

huaxiangsun · 2022-01-05T20:34:05Z

…base-1 and hbase-2

Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results
fetched are wasted at the client side.

…base-1 and hbase-2 Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results fetched are wasted at the client side.

Apache-HBase · 2022-01-05T21:52:37Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 33s	Docker mode activated.
-0 ⚠️	yetus	0m 6s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ branch-2 Compile Tests _
+1 💚	mvninstall	4m 37s	branch-2 passed
+1 💚	compile	0m 33s	branch-2 passed
+1 💚	shadedjars	7m 17s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 33s	branch-2 passed
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 14s	the patch passed
+1 💚	compile	0m 33s	the patch passed
+1 💚	javac	0m 33s	the patch passed
+1 💚	shadedjars	7m 23s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 30s	the patch passed
		_ Other Tests _
+1 💚	unit	2m 45s	hbase-client in the patch passed.
		30m 27s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#4008
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 6beb72b659dd 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `755b3b4`
Default Java	AdoptOpenJDK-11.0.10+9
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/1/testReport/
Max. process+thread count	301 (vs. ulimit of 12500)
modules	C: hbase-client U: hbase-client
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/1/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2022-01-05T21:57:32Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 31s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ branch-2 Compile Tests _
+1 💚	mvninstall	3m 52s	branch-2 passed
+1 💚	compile	1m 8s	branch-2 passed
+1 💚	checkstyle	0m 35s	branch-2 passed
+1 💚	spotbugs	1m 13s	branch-2 passed
		_ Patch Compile Tests _
+1 💚	mvninstall	3m 30s	the patch passed
+1 💚	compile	1m 5s	the patch passed
+1 💚	javac	1m 5s	the patch passed
+1 💚	checkstyle	0m 33s	the patch passed
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	12m 42s	Patch does not cause any errors with Hadoop 3.1.2 3.2.1.
+1 💚	spotbugs	1m 24s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 15s	The patch does not generate ASF License warnings.
		34m 55s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#4008
Optional Tests	dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile
uname	Linux bdff5387af3d 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `755b3b4`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Max. process+thread count	96 (vs. ulimit of 12500)
modules	C: hbase-client U: hbase-client
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/1/console
versions	git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2022-01-05T21:58:17Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	7m 9s	Docker mode activated.
-0 ⚠️	yetus	0m 5s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ branch-2 Compile Tests _
+1 💚	mvninstall	4m 27s	branch-2 passed
+1 💚	compile	0m 29s	branch-2 passed
+1 💚	shadedjars	7m 20s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 27s	branch-2 passed
		_ Patch Compile Tests _
+1 💚	mvninstall	4m 8s	the patch passed
+1 💚	compile	0m 30s	the patch passed
+1 💚	javac	0m 30s	the patch passed
+1 💚	shadedjars	7m 20s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 24s	the patch passed
		_ Other Tests _
+1 💚	unit	2m 57s	hbase-client in the patch passed.
		36m 35s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#4008
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 3db483033594 4.15.0-142-generic #146-Ubuntu SMP Tue Apr 13 01:11:19 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `755b3b4`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/1/testReport/
Max. process+thread count	234 (vs. ulimit of 12500)
modules	C: hbase-client U: hbase-client
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/1/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

huaxiangsun · 2022-01-06T17:45:34Z

Thanks Duo for the review. I restarted pr-merge check to get a successful run.

Apache-HBase · 2022-01-06T18:16:09Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	2m 30s	Docker mode activated.
-0 ⚠️	yetus	0m 7s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ branch-2 Compile Tests _
+1 💚	mvninstall	4m 20s	branch-2 passed
+1 💚	compile	0m 29s	branch-2 passed
+1 💚	shadedjars	7m 9s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 27s	branch-2 passed
		_ Patch Compile Tests _
+1 💚	mvninstall	3m 59s	the patch passed
+1 💚	compile	0m 28s	the patch passed
+1 💚	javac	0m 28s	the patch passed
+1 💚	shadedjars	7m 9s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 25s	the patch passed
		_ Other Tests _
+1 💚	unit	3m 9s	hbase-client in the patch passed.
		31m 11s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/2/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR	#4008
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 14384a5fb66e 4.15.0-163-generic #171-Ubuntu SMP Fri Nov 5 11:55:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `7db2777`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/2/testReport/
Max. process+thread count	228 (vs. ulimit of 12500)
modules	C: hbase-client U: hbase-client
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/2/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2022-01-06T18:19:31Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	0m 36s	Docker mode activated.
		_ Prechecks _
+1 💚	dupname	0m 0s	No case conflicting files found.
+1 💚	hbaseanti	0m 0s	Patch does not have any anti-patterns.
+1 💚	@author	0m 0s	The patch does not contain any @author tags.
		_ branch-2 Compile Tests _
+1 💚	mvninstall	3m 32s	branch-2 passed
+1 💚	compile	1m 9s	branch-2 passed
+1 💚	checkstyle	0m 33s	branch-2 passed
+1 💚	spotbugs	1m 12s	branch-2 passed
		_ Patch Compile Tests _
+1 💚	mvninstall	3m 36s	the patch passed
+1 💚	compile	1m 8s	the patch passed
+1 💚	javac	1m 8s	the patch passed
+1 💚	checkstyle	0m 34s	the patch passed
+1 💚	whitespace	0m 0s	The patch has no whitespace issues.
+1 💚	hadoopcheck	12m 48s	Patch does not cause any errors with Hadoop 3.1.2 3.2.1.
+1 💚	spotbugs	1m 28s	the patch passed
		_ Other Tests _
+1 💚	asflicense	0m 12s	The patch does not generate ASF License warnings.
		34m 35s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR	#4008
Optional Tests	dupname asflicense javac spotbugs hadoopcheck hbaseanti checkstyle compile
uname	Linux 7c8ab41c1871 4.15.0-156-generic #163-Ubuntu SMP Thu Aug 19 23:31:58 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `7db2777`
Default Java	AdoptOpenJDK-1.8.0_282-b08
Max. process+thread count	96 (vs. ulimit of 12500)
modules	C: hbase-client U: hbase-client
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/2/console
versions	git=2.17.1 maven=3.6.3 spotbugs=4.2.2
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

Apache-HBase · 2022-01-06T18:20:18Z

🎊 +1 overall

Vote	Subsystem	Runtime	Comment
+0 🆗	reexec	1m 40s	Docker mode activated.
-0 ⚠️	yetus	0m 6s	Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
		_ Prechecks _
		_ branch-2 Compile Tests _
+1 💚	mvninstall	5m 27s	branch-2 passed
+1 💚	compile	0m 36s	branch-2 passed
+1 💚	shadedjars	8m 20s	branch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 33s	branch-2 passed
		_ Patch Compile Tests _
+1 💚	mvninstall	5m 3s	the patch passed
+1 💚	compile	0m 37s	the patch passed
+1 💚	javac	0m 37s	the patch passed
+1 💚	shadedjars	8m 9s	patch has no errors when building our shaded downstream artifacts.
+1 💚	javadoc	0m 31s	the patch passed
		_ Other Tests _
+1 💚	unit	3m 12s	hbase-client in the patch passed.
		35m 17s

Subsystem	Report/Notes
Docker	ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR	#4008
Optional Tests	javac javadoc unit shadedjars compile
uname	Linux 3c0edbb0e550 4.15.0-163-generic #171-Ubuntu SMP Fri Nov 5 11:55:11 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool	maven
Personality	dev-support/hbase-personality.sh
git revision	branch-2 / `7db2777`
Default Java	AdoptOpenJDK-11.0.10+9
Test Results	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/2/testReport/
Max. process+thread count	215 (vs. ulimit of 12500)
modules	C: hbase-client U: hbase-client
Console output	https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-4008/2/console
versions	git=2.17.1 maven=3.6.3
Powered by	Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

…base-1 and hbase-2 (apache#4008) Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results fetched are wasted at the client side. Signed-off-by: Duo Zhang <zhangduo@apache.org>

…base-1 and hbase-2 (#4008) (#4011) Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results fetched are wasted at the client side. Signed-off-by: Duo Zhang <zhangduo@apache.org>

…base-1 and hbase-2 (#4008) (#4012) Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results fetched are wasted at the client side. Signed-off-by: Duo Zhang <zhangduo@apache.org>

…base-1 and hbase-2 (#4008) (#4013) Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results fetched are wasted at the client side. Signed-off-by: Duo Zhang <zhangduo@apache.org>

…gression between hbase-1 and hbase-2 (apache#4008) Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results fetched are wasted at the client side. Signed-off-by: Duo Zhang <zhangduo@apache.org>

…base-1 and hbase-2 (apache#4008) (apache#4012) Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results fetched are wasted at the client side. Signed-off-by: Duo Zhang <zhangduo@apache.org> (cherry picked from commit f3639bc) Change-Id: I8077d6133318b66728f8111d9a07290ed943c0bd

HBASE-26590 Hbase-client Meta lookup performance regression between h…

1427687

…base-1 and hbase-2 Change scan caching back to 1 to avoid extra work at Region Server side. For most cases, the extra 4 results fetched are wasted at the client side.

huaxiangsun requested a review from Apache9 January 5, 2022 20:34

Apache9 approved these changes Jan 6, 2022

View reviewed changes

huaxiangsun merged commit c897ce9 into apache:branch-2 Jan 6, 2022

This was referenced Jan 6, 2022

HBASE-26590 Hbase-client Meta lookup performance regression between h… #4011

Merged

HBASE-26590 Hbase-client Meta lookup performance regression between h… #4012

Merged

HBASE-26590 Hbase-client Meta lookup performance regression between h… #4013

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HBASE-26590 Hbase-client Meta lookup performance regression between h… #4008

HBASE-26590 Hbase-client Meta lookup performance regression between h… #4008

huaxiangsun commented Jan 5, 2022

Apache-HBase commented Jan 5, 2022

Apache-HBase commented Jan 5, 2022

Apache-HBase commented Jan 5, 2022

huaxiangsun commented Jan 6, 2022

Apache-HBase commented Jan 6, 2022

Apache-HBase commented Jan 6, 2022

Apache-HBase commented Jan 6, 2022

HBASE-26590 Hbase-client Meta lookup performance regression between h… #4008

HBASE-26590 Hbase-client Meta lookup performance regression between h… #4008

Conversation

huaxiangsun commented Jan 5, 2022

Apache-HBase commented Jan 5, 2022

Apache-HBase commented Jan 5, 2022

Apache-HBase commented Jan 5, 2022

huaxiangsun commented Jan 6, 2022

Apache-HBase commented Jan 6, 2022

Apache-HBase commented Jan 6, 2022

Apache-HBase commented Jan 6, 2022