Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

xz compression in to_csv() #11852

Closed
ohadle opened this issue Dec 16, 2015 · 4 comments
Closed

xz compression in to_csv() #11852

ohadle opened this issue Dec 16, 2015 · 4 comments
Labels
Enhancement IO CSV read_csv, to_csv
Milestone

Comments

@ohadle
Copy link

ohadle commented Dec 16, 2015

I use compression directly in DataFrame.to_csv() to save on disk space / IO. Would be nice to have support for xz compression there.

Similar to https://github.com/pydata/pandas/issues/8654, but I think in to_csv this has more added value.

@jreback
Copy link
Contributor

jreback commented Dec 16, 2015

I suppose if someone wanted to add additional compressor to read/write csv, this would be ok.

can you point to the canonical package which implements this compressor?

@jreback jreback added this to the Someday milestone Dec 16, 2015
@ohadle
Copy link
Author

ohadle commented Dec 16, 2015

I haven't tried it myself, but it looks like for python 3 it would be https://docs.python.org/3/library/lzma.html. For 2.7 this looks like it: https://github.com/peterjc/backports.lzma

@jreback
Copy link
Contributor

jreback commented Dec 16, 2015

sure that looks reasonable.

@jreback jreback modified the milestones: 0.18.1, Someday Mar 18, 2016
jreback pushed a commit to jreback/pandas that referenced this issue Mar 23, 2016
@ohadle
Copy link
Author

ohadle commented Mar 23, 2016

Thanks! I'll be using this immediately when the version comes out.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Enhancement IO CSV read_csv, to_csv
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants