Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Already on GitHub? Sign in to your account

Snappy compression breaks from.dfs #42

Open
piccolbo opened this Issue Jan 25, 2012 · 3 comments

Comments

Projects
None yet
1 participant
Collaborator

piccolbo commented Jan 25, 2012

No description provided.

Collaborator

piccolbo commented Jan 30, 2012

this should be fixed in dev now as from/to dfs are implemented as streaming jobs and so should use whatever compression streaming uses. Can't test right now because of OS issues (snappy and OS X). But will soon

Collaborator

piccolbo commented Feb 1, 2012

Tested that all check pass with compression on, default codec. Still need to figure out how to turn on snappy on whirr/aws

Collaborator

piccolbo commented Feb 2, 2012

It appears that the files were not compressed even if the configurations seemed to set compression on. Investigating.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment