Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HBASE-27006 Move nightly integration testing to new larger test node class. #4438

Merged
merged 2 commits into from
May 18, 2022

Conversation

busbey
Copy link
Contributor

@busbey busbey commented May 16, 2022

Since the integration tests will eventually run on the large nodes w/k8s, have them start running their now to validate that we can schedule on the nodes.

Did a scan through our other jenkinsfiles and I believe everything except for dev-support/adhoc_run_tests/Jenkinsfile is strongly tied to the hbase label and thus will stay off of hbase-large. I also don't think we have that job configured to run at all, so maybe a follow on should delete it.

@Apache-HBase

This comment was marked as outdated.

@Apache-HBase

This comment was marked as outdated.

@Apache-HBase

This comment was marked as outdated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 0m 55s Docker mode activated.
_ Prechecks _
+1 💚 dupname 0m 0s No case conflicting files found.
+0 🆗 shelldocs 0m 0s Shelldocs was not available.
+1 💚 @author 0m 0s The patch does not contain any @author tags.
_ master Compile Tests _
+0 🆗 mvndep 0m 13s Maven dependency ordering for branch
-1 ❌ spotless 0m 13s branch has 25 errors when running spotless:check, run spotless:apply to fix.
_ Patch Compile Tests _
+0 🆗 mvndep 0m 4s Maven dependency ordering for patch
+1 💚 shellcheck 0m 0s There were no new shellcheck issues.
+1 💚 whitespace 0m 0s The patch has no whitespace issues.
-1 ❌ spotless 0m 10s patch has 25 errors when running spotless:check, run spotless:apply to fix.
_ Other Tests _
+0 🆗 asflicense 0m 0s ASF License check generated no output?
2m 38s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4438/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR #4438
Optional Tests dupname asflicense spotless shellcheck shelldocs
uname Linux b87785fa9900 5.4.0-1043-aws #45~18.04.1-Ubuntu SMP Fri Apr 9 23:32:25 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / b787648
spotless https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4438/2/artifact/yetus-general-check/output/branch-spotless.txt
spotless https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4438/2/artifact/yetus-general-check/output/patch-spotless.txt
Max. process+thread count 34 (vs. ulimit of 30000)
modules C: U:
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4438/2/console
versions git=2.17.1 maven=3.6.3 shellcheck=0.4.6
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 1m 23s Docker mode activated.
-0 ⚠️ yetus 0m 4s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗 mvndep 0m 13s Maven dependency ordering for branch
_ Patch Compile Tests _
+0 🆗 mvndep 0m 4s Maven dependency ordering for patch
_ Other Tests _
2m 34s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4438/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR #4438
Optional Tests
uname Linux 4fd5eb66b210 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / b787648
Max. process+thread count 37 (vs. ulimit of 30000)
modules C: U:
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4438/2/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
+0 🆗 reexec 1m 15s Docker mode activated.
-0 ⚠️ yetus 0m 2s Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+0 🆗 mvndep 0m 12s Maven dependency ordering for branch
_ Patch Compile Tests _
+0 🆗 mvndep 0m 5s Maven dependency ordering for patch
_ Other Tests _
2m 24s
Subsystem Report/Notes
Docker ClientAPI=1.41 ServerAPI=1.41 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4438/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile
GITHUB PR #4438
Optional Tests
uname Linux 92ab31b2afe3 5.4.0-90-generic #101-Ubuntu SMP Fri Oct 15 20:00:55 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Build tool maven
Personality dev-support/hbase-personality.sh
git revision master / b787648
Max. process+thread count 33 (vs. ulimit of 30000)
modules C: U:
Console output https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4438/2/console
versions git=2.17.1 maven=3.6.3
Powered by Apache Yetus 0.12.0 https://yetus.apache.org

This message was automatically generated.

@busbey
Copy link
Contributor Author

busbey commented May 18, 2022

here's an example nightly run on a feature branch that looks to go smoothly:

https://ci-hbase.apache.org/job/HBase%20Nightly/job/HBASE-27006/2/

Copy link
Contributor

@saintstack saintstack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Try it. Do you have to make subsequent change to make it so only the integration tests run on hbase-large? Thanks.

@busbey
Copy link
Contributor Author

busbey commented May 18, 2022

this should already do that. the large nodes don't have the hbase label, so they shouldn't get any of the jobs that target that label. with this change the integration test should only target the abase-large labeled nodes.

@busbey busbey merged commit 76d20fc into apache:master May 18, 2022
@busbey busbey deleted the HBASE-27006 branch May 18, 2022 19:32
busbey added a commit that referenced this pull request May 19, 2022
busbey added a commit that referenced this pull request May 19, 2022
busbey added a commit that referenced this pull request May 19, 2022
busbey added a commit that referenced this pull request May 19, 2022
wenwj0 pushed a commit to wenwj0/hbase that referenced this pull request Jun 14, 2022
wenwj0 added a commit to wenwj0/hbase that referenced this pull request Jun 14, 2022
vinayakphegde pushed a commit to vinayakphegde/hbase that referenced this pull request Apr 4, 2024
…class. (apache#4438)

(cherry picked from commit 76d20fc)
Change-Id: Ibe5775fa93a7f89d0b54557dd9808bf73e3c2bbd
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants