-
Notifications
You must be signed in to change notification settings - Fork 140
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Improvement]LocalStorage init use multi thread #71 #72
Conversation
server/src/main/java/org/apache/uniffle/server/storage/LocalStorageManager.java
Outdated
Show resolved
Hide resolved
Test case is needed for this improvement |
Could you modify the description according to our pull request template? We will use the description as commit message, the commit message will provide more information to help people understand the code. |
Codecov Report
@@ Coverage Diff @@
## master #72 +/- ##
============================================
- Coverage 56.39% 56.38% -0.02%
- Complexity 1173 1179 +6
============================================
Files 149 149
Lines 7953 8013 +60
Branches 761 767 +6
============================================
+ Hits 4485 4518 +33
- Misses 3226 3250 +24
- Partials 242 245 +3
Help us with your feedback. Take ten seconds to tell us how you rate us. |
server/src/main/java/org/apache/uniffle/server/storage/LocalStorageManager.java
Show resolved
Hide resolved
server/src/main/java/org/apache/uniffle/server/storage/LocalStorageManager.java
Show resolved
Hide resolved
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks for your contribution @xianjingfeng .
What changes were proposed in this pull request?
use multi thread to clean local storage
Why are the changes needed?
If shuffle server exit abnormally, there will be many files need to be clear when shuffle server start again and this operation will cost a lot of time
Does this PR introduce any user-facing change?
No
How was this patch tested?
No need