Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HBASE-22072 High read/write intensive regions may cause long crash #214

Merged
merged 2 commits into from
May 8, 2019

Conversation

ramkrish86
Copy link
Contributor

Allows either updateReaders() or close() to happen at the same time. The JIRA reporter has tested the fix provided.

@ramkrish86 ramkrish86 self-assigned this May 3, 2019
@Apache-HBase
Copy link

💔 -1 overall

Vote Subsystem Runtime Comment
0 reexec 21 Docker mode activated.
_ Prechecks _
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1 mvninstall 236 master passed
+1 compile 53 master passed
+1 checkstyle 68 master passed
+1 shadedjars 263 branch has no errors when building our shaded downstream artifacts.
+1 findbugs 215 master passed
+1 javadoc 32 master passed
_ Patch Compile Tests _
+1 mvninstall 232 the patch passed
+1 compile 53 the patch passed
+1 javac 53 the patch passed
-1 checkstyle 68 hbase-server: The patch generated 1 new + 33 unchanged - 0 fixed = 34 total (was 33)
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 262 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 486 Patch does not cause any errors with Hadoop 2.7.4 or 3.0.0.
+1 findbugs 228 the patch passed
+1 javadoc 34 the patch passed
_ Other Tests _
+1 unit 8187 hbase-server in the patch passed.
+1 asflicense 28 The patch does not generate ASF License warnings.
10604
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-214/1/artifact/out/Dockerfile
GITHUB PR #214
Optional Tests dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux 2b57849c3013 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /testptch/patchprocess/precommit/personality/provided.sh
git revision master / 0c0d595
maven version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java 1.8.0_181
findbugs v3.1.11
checkstyle https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-214/1/artifact/out/diff-checkstyle-hbase-server.txt
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-214/1/testReport/
Max. process+thread count 4993 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-214/1/console
Powered by Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@carp84
Copy link
Member

carp84 commented May 4, 2019

Please check and fix the checkstyle issue as reported.

The change itself looks good but I need some time to read and fully understand the issue and solution as discussed in HBASE-22072. Will be back once done. Thanks.

Copy link
Contributor

@anoopsjohn anoopsjohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pls address the volatile comment and then we are good to go.. I think this will solve many strange issues that we were seeing with the new way of delayed compacted files cleanup. Good one.

@ramkrish86
Copy link
Contributor Author

Made the 'closing' variable to volatile. fixed checkstyle issue and moved the test to a new class.

@Apache-HBase
Copy link

🎊 +1 overall

Vote Subsystem Runtime Comment
0 reexec 21 Docker mode activated.
_ Prechecks _
+1 hbaseanti 0 Patch does not have any anti-patterns.
+1 @author 0 The patch does not contain any @author tags.
+1 test4tests 0 The patch appears to include 2 new or modified test files.
_ master Compile Tests _
+1 mvninstall 241 master passed
+1 compile 52 master passed
+1 checkstyle 68 master passed
+1 shadedjars 263 branch has no errors when building our shaded downstream artifacts.
+1 findbugs 180 master passed
+1 javadoc 30 master passed
_ Patch Compile Tests _
+1 mvninstall 236 the patch passed
+1 compile 53 the patch passed
+1 javac 53 the patch passed
+1 checkstyle 67 the patch passed
+1 whitespace 0 The patch has no whitespace issues.
+1 shadedjars 254 patch has no errors when building our shaded downstream artifacts.
+1 hadoopcheck 492 Patch does not cause any errors with Hadoop 2.7.4 or 3.0.0.
+1 findbugs 183 the patch passed
+1 javadoc 30 the patch passed
_ Other Tests _
+1 unit 8170 hbase-server in the patch passed.
+1 asflicense 23 The patch does not generate ASF License warnings.
10442
Subsystem Report/Notes
Docker Client=17.05.0-ce Server=17.05.0-ce base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-214/2/artifact/out/Dockerfile
GITHUB PR #214
Optional Tests dupname asflicense javac javadoc unit findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
uname Linux acf73fbc5e02 4.4.0-139-generic #165-Ubuntu SMP Wed Oct 24 10:58:50 UTC 2018 x86_64 GNU/Linux
Build tool maven
Personality /testptch/patchprocess/precommit/personality/provided.sh
git revision master / 45bcb4f
maven version: Apache Maven 3.5.4 (1edded0938998edf8bf061f1ceb3cfdeccf443fe; 2018-06-17T18:33:14Z)
Default Java 1.8.0_181
findbugs v3.1.11
Test Results https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-214/2/testReport/
Max. process+thread count 4983 (vs. ulimit of 10000)
modules C: hbase-server U: hbase-server
Console output https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-214/2/console
Powered by Apache Yetus 0.9.0 http://yetus.apache.org

This message was automatically generated.

@ramkrish86
Copy link
Contributor Author

Seems all good now in terms of QA.

Copy link
Contributor

@anoopsjohn anoopsjohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1

@ramkrish86 ramkrish86 merged commit 46fe983 into apache:master May 8, 2019
ramkrish86 pushed a commit that referenced this pull request May 8, 2019
)

* HBASE-22072 High read/write intensive regions may cause long crash
recovery

* Make the 'closing' variable as volatile and move the test case to
standlone class
ramkrish86 pushed a commit that referenced this pull request May 8, 2019
)

* HBASE-22072 High read/write intensive regions may cause long crash
recovery

* Make the 'closing' variable as volatile and move the test case to
standlone class
ramkrish86 pushed a commit that referenced this pull request May 8, 2019
)

* HBASE-22072 High read/write intensive regions may cause long crash
recovery

* Make the 'closing' variable as volatile and move the test case to
standlone class
ramkrish86 pushed a commit that referenced this pull request May 8, 2019
)

* HBASE-22072 High read/write intensive regions may cause long crash
recovery

* Make the 'closing' variable as volatile and move the test case to
standlone class
infraio pushed a commit to infraio/hbase that referenced this pull request Aug 17, 2020
…pache#214)

* HBASE-22072 High read/write intensive regions may cause long crash
recovery

* Make the 'closing' variable as volatile and move the test case to
standlone class
symat pushed a commit to symat/hbase that referenced this pull request Feb 17, 2021
…pache#214)

* HBASE-22072 High read/write intensive regions may cause long crash
recovery

* Make the 'closing' variable as volatile and move the test case to
standlone class

(cherry picked from commit 8d56693)

Change-Id: I3bd6e4f030458516aebe3c7adb96712cbef16b20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants