-
Notifications
You must be signed in to change notification settings - Fork 526
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix(source): build connector when calling next
#1746
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
/// the future that builds stream_reader. It is required because source should not establish | ||
/// connections to the upstream before `next` is called |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We can avoid this when we migrate SourceExecutor
to executor v2. 😁
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
next time for sure 👍
The migration will happen after making source running!
Signed-off-by: tabVersion <tabvision@bupt.icu>
Codecov Report
@@ Coverage Diff @@
## main #1746 +/- ##
==========================================
- Coverage 71.16% 71.16% -0.01%
==========================================
Files 600 600
Lines 77727 77743 +16
==========================================
+ Hits 55317 55328 +11
- Misses 22410 22415 +5
Flags with carried forward coverage won't be shown. Click here to find out more.
📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more |
setup timed out, need merge #1752 first |
What's changed and what's your intention?
PLEASE DO NOT LEAVE THIS EMPTY !!!
Please explain IN DETAIL what the changes are in this PR and why they are needed:
in prev impl, connection to upstream is established when source is registered. Here to change that into a future and await when calling next, which means no connection is built until there is data demand.
Checklist
Refer to a related PR or issue link (optional)