Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix potenial missing reads of exclude nodes #269

Merged
merged 1 commit into from
Oct 18, 2022
Merged

Conversation

zuston
Copy link
Member

@zuston zuston commented Oct 18, 2022

What changes were proposed in this pull request?

Use the original latest modification time to fix potenial missing reads of exclude nodes

Why are the changes needed?

I found that after doing parseExcludeNodesFile(hadoopFileSystem.open(hadoopPath));, the file was updated of adding the new nodes, in the current implementation, the newly added nodes wont be recognized.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Dont need

@codecov-commenter
Copy link

codecov-commenter commented Oct 18, 2022

Codecov Report

Merging #269 (818a171) into master (8be8390) will increase coverage by 0.03%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##             master     #269      +/-   ##
============================================
+ Coverage     59.70%   59.73%   +0.03%     
- Complexity     1377     1378       +1     
============================================
  Files           166      166              
  Lines          8916     8918       +2     
  Branches        853      853              
============================================
+ Hits           5323     5327       +4     
+ Misses         3318     3317       -1     
+ Partials        275      274       -1     
Impacted Files Coverage Δ
...ache/uniffle/coordinator/SimpleClusterManager.java 86.82% <100.00%> (+0.20%) ⬆️
...he/uniffle/server/buffer/ShuffleBufferManager.java 83.33% <0.00%> (+0.79%) ⬆️

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@zuston zuston requested a review from jerqi October 18, 2022 06:10
Copy link
Contributor

@jerqi jerqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @zuston

@jerqi
Copy link
Contributor

jerqi commented Oct 18, 2022

Have you tested this patch by hand?

@zuston
Copy link
Member Author

zuston commented Oct 18, 2022

Have you tested this patch by hand?

Yes.

@jerqi jerqi merged commit b845381 into apache:master Oct 18, 2022
@zuston zuston deleted the fixTime branch October 18, 2022 14:18
kaijchen pushed a commit that referenced this pull request Nov 12, 2022
### What changes were proposed in this pull request?
Use the original latest modification time to fix potenial missing reads of exclude nodes

### Why are the changes needed?
I found that after doing `parseExcludeNodesFile(hadoopFileSystem.open(hadoopPath));`, the file was updated of adding the new nodes, in the current implementation, the newly added nodes wont be recognized.

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
By hand
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants