Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature][connectors-v2][connector-file] Add support for reading and writing compressed files, such as tar.gz, zip, etc #7587

Closed
2 of 3 tasks
wuchunfu opened this issue Sep 5, 2024 · 7 comments

Comments

@wuchunfu
Copy link
Member

wuchunfu commented Sep 5, 2024

Search before asking

  • I had searched in the feature and found no similar feature requirement.

Description

Now it seems that our file connectors do not support reading compressed files, such as tar.gz, zip, and other types of files, and adding common types of compressed files for reading and writing

Usage Scenario

No response

Related issues

No response

Are you willing to submit a PR?

  • Yes I am willing to submit a PR!

Code of Conduct

@corgy-w
Copy link
Contributor

corgy-w commented Sep 5, 2024

Can be assigned to me temporarily

@corgy-w
Copy link
Contributor

corgy-w commented Sep 5, 2024

@wuchunfu #6826 I think binary can actually represent compressed files. should we distinguish them?

@wuchunfu
Copy link
Member Author

wuchunfu commented Sep 5, 2024

@wuchunfu #6826 I think binary can actually represent compressed files. should we distinguish them?

@corgy-w Binary seems impossible, so how to store a compressed file instead of just transferring it

@corgy-w
Copy link
Contributor

corgy-w commented Sep 9, 2024

Now there are two ways to achieve, hope express their views

  1. in the case of not adding new types to support zip, etc., for example: there is text.zip is essentially a text file needs to be imported, parse the zip file can be
  2. add a new type of suffix, reuse the processing logic of various formats, scalability is strong

Personally prefer the first option

@corgy-w
Copy link
Contributor

corgy-w commented Sep 10, 2024

Now there are two ways to achieve, hope express their views

  1. in the case of not adding new types to support zip, etc., for example: there is text.zip is essentially a text file needs to be imported, parse the zip file can be
  2. add a new type of suffix, reuse the processing logic of various formats, scalability is strong

Personally prefer the first option

Choose 1

Copy link

This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.

@github-actions github-actions bot added the stale label Oct 11, 2024
Copy link

github-actions bot commented Nov 8, 2024

This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.

@github-actions github-actions bot closed this as completed Nov 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants