Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Improvement] Write hdfs files asynchronously when detectStorage #678

Closed
3 tasks done
smallzhongfeng opened this issue Mar 3, 2023 · 0 comments · Fixed by #680
Closed
3 tasks done

[Improvement] Write hdfs files asynchronously when detectStorage #678

smallzhongfeng opened this issue Mar 3, 2023 · 0 comments · Fixed by #680
Assignees
@smallzhongfeng

Comments

@smallzhongfeng
Copy link
Contributor

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

What would you like to be improved?

Write files to hdfs asynchronously.

How should we improve?

Reduce the time of detectStorage

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@smallzhongfeng smallzhongfeng self-assigned this Mar 3, 2023
smallzhongfeng pushed a commit to smallzhongfeng/incubator-uniffle that referenced this issue Mar 3, 2023
[apache#678] improvement: Write hdfs files asynchronously when detect…
c186d7d 
…Storage
@smallzhongfeng smallzhongfeng mentioned this issue Mar 3, 2023
Merged
advancedxy pushed a commit that referenced this issue Mar 6, 2023
@smallzhongfeng
[#678] improvement: Write hdfs files asynchronously when `detectStora…
d140e4e 
…ge` (#680)

### What changes were proposed in this pull request?
Write files to hdfs asynchronously and reduce the time of detectStorage

### Why are the changes needed?
Fix: #678 

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Origin uts.
advancedxy pushed a commit to advancedxy/incubator-uniffle that referenced this issue Mar 21, 2023
@smallzhongfeng @advancedxy
[apache#678] improvement: Write hdfs files asynchronously when `detec…
c57cb78 
…tStorage` (apache#680)

### What changes were proposed in this pull request?
Write files to hdfs asynchronously and reduce the time of detectStorage

### Why are the changes needed?
Fix: apache#678 

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Origin uts.
xianjingfeng pushed a commit to xianjingfeng/incubator-uniffle that referenced this issue Apr 5, 2023
@smallzhongfeng
[apache#678] improvement: Write hdfs files asynchronously when `detec…
15ec181 
…tStorage` (apache#680)

### What changes were proposed in this pull request?
Write files to hdfs asynchronously and reduce the time of detectStorage

### Why are the changes needed?
Fix: apache#678 

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
Origin uts.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@smallzhongfeng smallzhongfeng

Labels
None yet
Projects
None yet
Milestone
No milestone
1 participant
@smallzhongfeng