Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Subtask] [Tez] Tez Shuffle Read supporting RemoteShuffle #854

Closed
3 tasks done
Tracked by #321
lifeSo opened this issue May 8, 2023 · 0 comments · Fixed by #920, #922, #929, #935 or #947
Closed
3 tasks done
Tracked by #321

[Subtask] [Tez] Tez Shuffle Read supporting RemoteShuffle #854

lifeSo opened this issue May 8, 2023 · 0 comments · Fixed by #920, #922, #929, #935 or #947
Assignees
@lifeSo

Comments

@lifeSo
Copy link
Collaborator

lifeSo commented May 8, 2023

Code of Conduct

Search before asking

  • I have searched in the issues and found no similar issues.

Describe the subtask

Tez Shuffle Read supporting RemoteShuffle

Parent issue

#321

Are you willing to submit PR?

  • Yes I am willing to submit a PR!
@jerqi jerqi changed the title [Subtask] [Tez] Tez Shuffle Read supporting RemoteShuffle #819 [Subtask] [Tez] Tez Shuffle Read supporting RemoteShuffle May 8, 2023
@jerqi jerqi mentioned this issue May 8, 2023
Closed
23 tasks
@lifeSo lifeSo mentioned this issue May 10, 2023
Closed
This was referenced Jun 2, 2023
Merged
Merged
@jerqi jerqi mentioned this issue Jun 2, 2023
Merged
@lifeSo lifeSo mentioned this issue Jun 5, 2023
Merged
@jerqi jerqi closed this as completed in #920 Jun 6, 2023
jerqi pushed a commit that referenced this issue Jun 6, 2023
@lifeSo
[#854][FOLLOWUP] feat(tez): add RssTezFetcher to fetch data from work…
fb8f4cf 
…er. (#920)

### What changes were proposed in this pull request?

add RssTezFetcher to fetch data from worker.

### Why are the changes needed?

Fix: #854

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?
unit test
@lifeSo lifeSo mentioned this issue Jun 7, 2023
Merged
jerqi pushed a commit that referenced this issue Jun 12, 2023
@lifeSo
[#854][FOLLOWUP] feat(tez): Add RssTezFetcherTask to fetch data from …
64ed935 
…worker for OrderedInput (#935)

### What changes were proposed in this pull request?
Add RssTezFetcherTask to fetch data from worker for OrderedInput

### Why are the changes needed?
Fix: #854

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?

unit test
jerqi pushed a commit that referenced this issue Jun 13, 2023
@lifeSo
[#854][FOLLOWUP] feat(tez): Add Simple Fetched Allocator to allocatio…
fb394e5 
…n memory or disk for shuffle data (#922)

### What changes were proposed in this pull request?
Add Simple Fetched Allocator to allcation memory or disk for shuffle data

### Why are the changes needed?
Fix: #854

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
unit test case
This was referenced Jun 13, 2023
Merged
Merged
Merged
jerqi pushed a commit that referenced this issue Jun 15, 2023
@lifeSo
[#854][FOLLOWUP] feat(tez): Add RssShuffleScheduler to run and manage…
c6d186c 
…r shuffle work (#948)

### What changes were proposed in this pull request?

Add RssShuffleScheduler to run and manager shuffle work

### Why are the changes needed?
Fix:  #854

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?
unit test
jerqi pushed a commit that referenced this issue Jun 16, 2023
@lifeSo
[#854][FOLLOWUP] feat(tez): Add RssShuffle to handle event and genera…
0ba2849 
…te fetch task (#929)

### What changes were proposed in this pull request?

add RssShuffle to handle event and generate fetch task

### Why are the changes needed?

Fix:  #854

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?

unit test
jerqi pushed a commit that referenced this issue Jun 21, 2023
@lifeSo
[#854][FOLLOWUP] feat(tez): Add RssShuffleManager to run and manager …
fbc0b22 
…shuffle work (#947)

### What changes were proposed in this pull request?

Add RssShuffleManager to run and manager shuffle work

### Why are the changes needed?


Fix: #854

### Does this PR introduce _any_ user-facing change?


No.

### How was this patch tested?

unit test
jerqi pushed a commit that referenced this issue Jun 25, 2023
@lifeSo
[#854][FOLLOWUP] feat(tez): Add Rss Input Class to begin Tez input ta…
60d9b21 
…sk (#949)

### What changes were proposed in this pull request?

Add Rss Input Class to begin Tez input task

### Why are the changes needed?

Fix: #854

### Does this PR introduce _any_ user-facing change?
No.

### How was this patch tested?

unit test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@lifeSo lifeSo

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[#854][FOLLOWUP] feat(tez): add RssTezFetcher to fetch data from worker. lifeSo/incubator-uniffle
[#854][FOLLOWUP] feat(tez): Add Simple Fetched Allocator to allocation memory or disk for shuffle data lifeSo/incubator-uniffle
[#854][FOLLOWUP] feat(tez): Add RssShuffle to handle event and generate fetch task lifeSo/incubator-uniffle
[#854][FOLLOWUP] feat(tez): Add RssTezFetcherTask to fetch data from worker for OrderedInput lifeSo/incubator-uniffle
[#854][FOLLOWUP] feat(tez): Add RssShuffleManager to run and manager shuffle work lifeSo/incubator-uniffle
[#854][FOLLOWUP] feat(tez): Add RssShuffleScheduler to run and manager shuffle work lifeSo/incubator-uniffle
[#854][FOLLOWUP] feat(tez): Add Rss Input Class to begin Tez input task lifeSo/incubator-uniffle
[#854][Part-1] feat(tez): Add Tez Input class
1 participant
@lifeSo