Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Snappy compression breaks from.dfs #42

piccolbo opened this Issue Jan 25, 2012 · 3 comments


None yet
1 participant

piccolbo commented Jan 25, 2012

No description provided.


piccolbo commented Jan 30, 2012

this should be fixed in dev now as from/to dfs are implemented as streaming jobs and so should use whatever compression streaming uses. Can't test right now because of OS issues (snappy and OS X). But will soon


piccolbo commented Feb 1, 2012

Tested that all check pass with compression on, default codec. Still need to figure out how to turn on snappy on whirr/aws


piccolbo commented Feb 2, 2012

It appears that the files were not compressed even if the configurations seemed to set compression on. Investigating.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment