-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
HBASE-22842 Tmp directory should not be deleted when master restart used for user scan snapshot feature #485
Conversation
@@ -319,19 +320,22 @@ void checkTempDir(final Path tmpdir, final Configuration c, final FileSystem fs) | |||
HFileArchiver.archiveRegions(c, fs, this.rootdir, tableDir, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The archiveRegions will archive all the hfiles and if all successfull... Then it will remains some dirs such as /.tmp/data/ns/table ? If we've deleted a namespace or table , the ns or table dir under .tmp will be also removed (If no, the we will remain many useless dir, that's not good) ?
Another concern is : if hfiles archiving failure happen and enable the snapshot acl sync, will we remain much hfiles under the .tmp dir ? will be storage consuming if so... maybe we need a UT ?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The tmp namespace or table dirs are deleted if namespace or table are dropped. There are UTs in TestSnapshotScannerHDFSAclController to check it.
Add a warn log to record unarchived regions, if this problem happens in practice, we can fix this? And add UT in TestSnapshotScannerHDFSAclController.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java
Show resolved
Hide resolved
🎊 +1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
2b6d2bf
to
c8e1319
Compare
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
…sed for user scan snapshot feature
c8e1319
to
f3d1696
Compare
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
💔 -1 overall
This message was automatically generated. |
…sed for user scan snapshot feature (#485)
…sed for user scan snapshot feature (apache#485)
No description provided.