-
Notifications
You must be signed in to change notification settings - Fork 526
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
refactor: use bounded channel for 3 channels #3273
Conversation
Codecov Report
@@ Coverage Diff @@
## main #3273 +/- ##
==========================================
- Coverage 73.23% 73.22% -0.01%
==========================================
Files 747 747
Lines 101789 101794 +5
==========================================
- Hits 74545 74543 -2
- Misses 27244 27251 +7
Flags with carried forward coverage won't be shown. Click here to find out more.
📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more |
for sender in &self.senders { | ||
sender | ||
.send(chunk.clone()) | ||
.to_rw_result_with(|| "BroadcastSender::send".into()) | ||
}) | ||
.await | ||
.to_rw_result_with(|| "BroadcastSender::send".into())?; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we send this in parallel?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes I thought about this. What about done this in anthor PR? Prevoius it is also not parallel.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
OK
@@ -122,17 +123,22 @@ impl HashShuffleSender { | |||
if new_data_chunk.cardinality() > 0 { | |||
self.senders[sink_id] | |||
.send(Some(new_data_chunk)) | |||
.await |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Send it in parallel.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Let's send data chunk in parallel later.
What's changed and what's your intention?
ref: #3024
For 3 channels:
FIFO, HASH, BROADCAST
Checklist
./risedev check
(or alias,./risedev c
)Refer to a related PR or issue link (optional)