Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Research: handle gzipped CSV directly #318

Open
simonw opened this issue Aug 18, 2021 · 2 comments
Open

Research: handle gzipped CSV directly #318

simonw opened this issue Aug 18, 2021 · 2 comments

Comments

@simonw
Copy link
Owner

simonw commented Aug 18, 2021

Would it be worthwhile for the sqlite-utils command-line tool to grow features to efficiently directly interact with gzipped CSV data?

Maybe add --gz options to both insert and to the various commands that output query results.

@simonw
Copy link
Owner Author

simonw commented Aug 18, 2021

Something like this then:

sqlite-utils file.db "select * from t" --csv --gz > t.csv.gz

Maybe add a -o t.csv.gz option too so you don't have to use a >.

@simonw
Copy link
Owner Author

simonw commented Aug 18, 2021

Some questions:

  • Should this support compression formats other than gzip?
  • Should memory learn to auto-detect gzipped data?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant