Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Improve][ftp] improvement ftp read/write performance #1470

Closed
2 of 3 tasks
zoudaokoulife opened this issue Jan 6, 2023 · 0 comments · Fixed by #1483
Closed
2 of 3 tasks

[Improve][ftp] improvement ftp read/write performance #1470

zoudaokoulife opened this issue Jan 6, 2023 · 0 comments · Fixed by #1483
Assignees
@mggger
Labels
feature-request this is a feature requests on the product

Comments

@zoudaokoulife
Copy link
Contributor

Search before asking

  • I had searched in the issues and found no similar feature requirement.

Description

when test the ftp reader connector, we find some function cost more time.
we need to improve the read performance. eg. split one big file to multi sub task;

Use case

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct
@zoudaokoulife zoudaokoulife added the feature-request this is a feature requests on the product label Jan 6, 2023
@FlechazoW FlechazoW changed the title [Feature][ftp] improvement ftp read/write performance [Improve][ftp] improvement ftp read/write performance Jan 6, 2023
@mggger mggger mentioned this issue Jan 10, 2023
Merged
9 tasks
FlechazoW pushed a commit that referenced this issue Jan 11, 2023
@mggger
[feat-#1470][ftp] improvement ftp read/write performance (#1483)
9d06b7d
ll076110 pushed a commit that referenced this issue Mar 3, 2023
@mggger
[feat-#1470][ftp] improvement ftp read/write performance (#1483)
b9e2a34 
(cherry picked from commit 9d06b7d)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@mggger mggger

Labels
feature-request this is a feature requests on the product
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

[feat-#1470][ftp] improvement ftp read/write performance mggger/chunjun
2 participants
@zoudaokoulife @mggger