New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

xz compression in to_csv() #11852

Closed
ohadle opened this Issue Dec 16, 2015 · 4 comments

Comments

Projects
None yet
2 participants
@ohadle

ohadle commented Dec 16, 2015

I use compression directly in DataFrame.to_csv() to save on disk space / IO. Would be nice to have support for xz compression there.

Similar to #8654, but I think in to_csv this has more added value.

@jreback

This comment has been minimized.

Show comment
Hide comment
@jreback

jreback Dec 16, 2015

Contributor

I suppose if someone wanted to add additional compressor to read/write csv, this would be ok.

can you point to the canonical package which implements this compressor?

Contributor

jreback commented Dec 16, 2015

I suppose if someone wanted to add additional compressor to read/write csv, this would be ok.

can you point to the canonical package which implements this compressor?

@ohadle

This comment has been minimized.

Show comment
Hide comment
@ohadle

ohadle Dec 16, 2015

I haven't tried it myself, but it looks like for python 3 it would be https://docs.python.org/3/library/lzma.html. For 2.7 this looks like it: https://github.com/peterjc/backports.lzma

ohadle commented Dec 16, 2015

I haven't tried it myself, but it looks like for python 3 it would be https://docs.python.org/3/library/lzma.html. For 2.7 this looks like it: https://github.com/peterjc/backports.lzma

@jreback

This comment has been minimized.

Show comment
Hide comment
@jreback

jreback Dec 16, 2015

Contributor

sure that looks reasonable.

Contributor

jreback commented Dec 16, 2015

sure that looks reasonable.

@jreback jreback modified the milestones: 0.18.1, Someday Mar 18, 2016

jreback added a commit to jreback/pandas that referenced this issue Mar 23, 2016

@jreback jreback closed this in 247fe07 Mar 23, 2016

@ohadle

This comment has been minimized.

Show comment
Hide comment
@ohadle

ohadle Mar 23, 2016

Thanks! I'll be using this immediately when the version comes out.

ohadle commented Mar 23, 2016

Thanks! I'll be using this immediately when the version comes out.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment