-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HBASE-21905: [FIFOCompaction] Don't compact already inflight store files #1829
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleanes up the test code a bit.
@openinx you added the relevant code and the test, can you please take a look when you get a chance? Thanks. While the PR is for branch-1, it also applies to other branches. Will forward-port once it is committed. |
💔 -1 overall
This message was automatically generated. |
Test failure doesn't seem related to the patch and is occasionally failing with similar symptoms on branch-1 (which is a separate issue).. |
apurtell
approved these changes
Jun 3, 2020
bharathv
added a commit
that referenced
this pull request
Jun 3, 2020
…les (#1829) This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleans up the test code a bit. Signed-off-by: Andrew Purtell <apurtell@apache.org>
bharathv
added a commit
that referenced
this pull request
Jun 4, 2020
…les (#1829) This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleans up the test code a bit. Signed-off-by: Andrew Purtell <apurtell@apache.org>
asfgit
pushed a commit
that referenced
this pull request
Jun 4, 2020
…les (#1829) This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleans up the test code a bit. Signed-off-by: Andrew Purtell <apurtell@apache.org>
asfgit
pushed a commit
that referenced
this pull request
Jun 4, 2020
…les (#1829) This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleans up the test code a bit. Signed-off-by: Andrew Purtell <apurtell@apache.org>
HomminLee
pushed a commit
to HomminLee/hbase
that referenced
this pull request
Jun 12, 2020
…les (apache#1829) This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleans up the test code a bit. Signed-off-by: Andrew Purtell <apurtell@apache.org>
infraio
pushed a commit
to infraio/hbase
that referenced
this pull request
Aug 17, 2020
…les (apache#1829) This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleans up the test code a bit. Signed-off-by: Andrew Purtell <apurtell@apache.org>
clarax
pushed a commit
to clarax/hbase
that referenced
this pull request
Nov 15, 2020
…les (apache#1829) This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleans up the test code a bit. Signed-off-by: Andrew Purtell <apurtell@apache.org>
wchevreuil
pushed a commit
to wchevreuil/hbase
that referenced
this pull request
May 24, 2021
…les (apache#1829) This one surfaced as a flake test but turns out to be a legit bug in FIFOCompaction code. FifoCompaction does not check if an empty store file is already being compacted by an in-flight compaction request and still enqueues. It can potentially race with a running compaction (as in this test case, see jira for the exact exception). Fixes the edge case and cleans up the test code a bit. Signed-off-by: Andrew Purtell <apurtell@apache.org> (cherry picked from commit 92bfd92) Change-Id: Ib23320b8570d635ae461f5f6fe4b382b94013bc0
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This one surfaced as a flake test but turns out to be a legit bug
in FIFOCompaction code. FifoCompaction does not check if an empty
store file is already being compacted by an in-flight compaction
request and still enqueues. It can potentially race with a running
compaction (as in this test case, see jira for the exact exception).
Fixes the edge case and cleans up the test code a bit.