Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HBASE-22941 merge operation returns parent regions in random order #556

Merged
merged 4 commits into from
Aug 29, 2019

Conversation

stoty
Copy link
Contributor

@stoty stoty commented Aug 28, 2019

store and return the merge parent regions in ascending order

remove left over check for exactly two merged regions

add unit test

store and return the merge parent regions in ascending order

remove left over check for exactly two merged regions

add unit test
Copy link
Contributor

@saintstack saintstack left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the fixes (and obviously, the testing that found these bugs). LGTM.

Will see how it does on build and will push if all good.

for (int c = 0; c < 19; c++) {
assertTrue(Bytes.compareTo(mergeParentRegions.get(c).getStartKey(), mergeParentRegions.get(c+1).getStartKey())<0);
}

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 130 Docker mode activated.
_ Prechecks _
+1 dupname 1 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1 mvninstall 512 master passed
+1 compile 87 master passed
+1 checkstyle 124 master passed
+1 shadedjars 406 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 47 master passed
0 spotbugs 342 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 338 master passed
_ Patch Compile Tests _
+1 mvninstall 433 the patch passed
+1 compile 79 the patch passed
+1 javac 79 the patch passed
-1 checkstyle 102 hbase-server: The patch generated 1 new + 17 unchanged - 0 fixed = 18 total (was 17)
-1 whitespace 0 The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1 shadedjars 409 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1436 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 50 the patch passed
+1 findbugs 377 the patch passed
_ Other Tests _
-1 unit 16348 hbase-server in the patch failed.
+1 asflicense 29 The patch does not generate ASF License warnings.
21493
Reason Tests
Failed junit tests hadoop.hbase.client.TestAdmin1
hadoop.hbase.client.TestFromClientSide3
hadoop.hbase.client.TestAsyncRegionAdminApi2
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/1/artifact/out/Dockerfile
GITHUB PR #556
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 34466454383b 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-556/out/precommit/personality/provided.sh
git revision master / 56980fb
Default Java 1.8.0_181
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/1/artifact/out/diff-checkstyle-hbase-server.txt
whitespace https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/1/artifact/out/whitespace-eol.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/1/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/1/testReport/
Max. process+thread count 4717 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/1/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

for (int c = 0; c < 19; c++) {
assertTrue(Bytes.compareTo(mergeParentRegions.get(c).getStartKey(), mergeParentRegions.get(c+1).getStartKey())<0);
}

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

whitespace:end of line

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 247 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1 mvninstall 526 master passed
+1 compile 90 master passed
+1 checkstyle 110 master passed
+1 shadedjars 401 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 54 master passed
0 spotbugs 376 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 373 master passed
_ Patch Compile Tests _
+1 mvninstall 478 the patch passed
+1 compile 91 the patch passed
+1 javac 91 the patch passed
-1 checkstyle 109 hbase-server: The patch generated 1 new + 17 unchanged - 0 fixed = 18 total (was 17)
-1 whitespace 0 The patch has 1 line(s) that end in whitespace. Use git apply --whitespace=fix <<patch_file>>. Refer https://git-scm.com/docs/git-apply
+1 shadedjars 392 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1430 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 46 the patch passed
+1 findbugs 328 the patch passed
_ Other Tests _
-1 unit 16527 hbase-server in the patch failed.
+1 asflicense 33 The patch does not generate ASF License warnings.
21759
Reason Tests
Failed junit tests hadoop.hbase.client.TestAsyncRegionAdminApi2
hadoop.hbase.client.TestAdmin1
hadoop.hbase.master.TestMasterShutdown
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/2/artifact/out/Dockerfile
GITHUB PR #556
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux d4e388688720 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-556/out/precommit/personality/provided.sh
git revision master / 56980fb
Default Java 1.8.0_181
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/2/artifact/out/diff-checkstyle-hbase-server.txt
whitespace https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/2/artifact/out/whitespace-eol.txt
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/2/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/2/testReport/
Max. process+thread count 4597 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/2/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 134 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1 mvninstall 484 master passed
+1 compile 79 master passed
+1 checkstyle 112 master passed
+1 shadedjars 368 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 45 master passed
0 spotbugs 317 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 313 master passed
_ Patch Compile Tests _
+1 mvninstall 404 the patch passed
+1 compile 72 the patch passed
+1 javac 72 the patch passed
+1 checkstyle 105 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 354 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 1282 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 38 the patch passed
+1 findbugs 276 the patch passed
_ Other Tests _
-1 unit 14116 hbase-server in the patch failed.
+1 asflicense 25 The patch does not generate ASF License warnings.
18683
Reason Tests
Failed junit tests hadoop.hbase.client.TestAsyncRegionAdminApi2
hadoop.hbase.client.TestAdmin1
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/3/artifact/out/Dockerfile
GITHUB PR #556
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux ecab9d120a63 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-556/out/precommit/personality/provided.sh
git revision master / 56980fb
Default Java 1.8.0_181
unit https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/3/artifact/out/patch-unit-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/3/testReport/
Max. process+thread count 4810 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/3/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 37 Docker mode activated.
_ Prechecks _
+1 dupname 0 No case conflicting files found.
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 3 new or modified test files.
_ master Compile Tests _
+1 mvninstall 378 master passed
+1 compile 57 master passed
+1 checkstyle 78 master passed
+1 shadedjars 273 branch has no errors when building our shaded downstream artifacts.
+1 javadoc 38 master passed
0 spotbugs 234 Used deprecated FindBugs config; considering switching to SpotBugs.
+1 findbugs 232 master passed
_ Patch Compile Tests _
+1 mvninstall 298 the patch passed
+1 compile 54 the patch passed
+1 javac 54 the patch passed
-1 checkstyle 76 hbase-server: The patch generated 1 new + 20 unchanged - 0 fixed = 21 total (was 20)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 269 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 932 Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 javadoc 35 the patch passed
+1 findbugs 233 the patch passed
_ Other Tests _
+1 unit 9463 hbase-server in the patch passed.
+1 asflicense 26 The patch does not generate ASF License warnings.
12853
Subsystem Report/Notes
Docker Client=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/4/artifact/out/Dockerfile
GITHUB PR #556
Optional Tests dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 04fe77053f9d 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build tool maven
Personality /home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-556/out/precommit/personality/provided.sh
git revision master / 56980fb
Default Java 1.8.0_181
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/4/artifact/out/diff-checkstyle-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/4/testReport/
Max. process+thread count 4389 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-556/4/console
versions git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered by Apache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@saintstack saintstack merged commit 56fd3e9 into apache:master Aug 29, 2019
asfgit pushed a commit that referenced this pull request Aug 29, 2019
@saintstack
Copy link
Contributor

Fixed checkstyle complaint in a follow-on addendum.

asfgit pushed a commit that referenced this pull request Aug 29, 2019
)

* HBASE-22941 merge operation returns parent regions in random order

store and return the merge parent regions in ascending order

remove left over check for exactly two merged regions

add unit test

* use SortedMap type to emphasise that the Map is sorted.

* use regionCount consistently and checkstyle fixes

* Delete tests that expect multiregion merges to fail.

Signed-off-by: stack <stack@apache.org>
@stoty stoty deleted the HBASE-22941 branch August 29, 2019 20:22
asfgit pushed a commit that referenced this pull request Sep 20, 2019
)

* HBASE-22941 merge operation returns parent regions in random order

store and return the merge parent regions in ascending order

remove left over check for exactly two merged regions

add unit test

* use SortedMap type to emphasise that the Map is sorted.

* use regionCount consistently and checkstyle fixes

* Delete tests that expect multiregion merges to fail.

Signed-off-by: stack <stack@apache.org>
asfgit pushed a commit that referenced this pull request Sep 20, 2019
)

* HBASE-22941 merge operation returns parent regions in random order

store and return the merge parent regions in ascending order

remove left over check for exactly two merged regions

add unit test

* use SortedMap type to emphasise that the Map is sorted.

* use regionCount consistently and checkstyle fixes

* Delete tests that expect multiregion merges to fail.

Signed-off-by: stack <stack@apache.org>
infraio pushed a commit to infraio/hbase that referenced this pull request Aug 17, 2020
…pache#556)

* HBASE-22941 merge operation returns parent regions in random order

store and return the merge parent regions in ascending order

remove left over check for exactly two merged regions

add unit test

* use SortedMap type to emphasise that the Map is sorted.

* use regionCount consistently and checkstyle fixes

* Delete tests that expect multiregion merges to fail.

Signed-off-by: stack <stack@apache.org>
symat pushed a commit to symat/hbase that referenced this pull request Feb 17, 2021
…pache#556)

* HBASE-22941 merge operation returns parent regions in random order

store and return the merge parent regions in ascending order

remove left over check for exactly two merged regions

add unit test

* use SortedMap type to emphasise that the Map is sorted.

* use regionCount consistently and checkstyle fixes

* Delete tests that expect multiregion merges to fail.

Signed-off-by: stack <stack@apache.org>
(cherry picked from commit 047aad1)

Change-Id: I081888b3205db4c34dc5df466edcdf34aae3cd76
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants