Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Brotli compression to Parquet #1940

Open
asfimport opened this issue Feb 10, 2016 · 1 comment
Open

Add Brotli compression to Parquet #1940

asfimport opened this issue Feb 10, 2016 · 1 comment

Comments

@asfimport
Copy link
Collaborator

asfimport commented Feb 10, 2016

Hi,

Google release a new compression algorithm called Brotli.
A new compression algorithm for the internet, as they claim.
Currently Firefox and Chrome (both developer editions) already
support Brotli, as such as e.g. ngingx.
http://google-opensource.blogspot.de/2015/09/introducing-brotli-new-compression.html

I'm the author of jbrotli - the Java bindings for brotli.

I'm curios and doing a survey, if jBrotli is an option for parquet?
Feedback is welcome.

Thanks in advance
Martin

Environment: all
Reporter: Martin W. Kirst
Assignee: Ryan Blue / @rdblue

Related issues:

PRs and other links:

Note: This issue was originally created as PARQUET-521. Please see the migration documentation for further details.

@asfimport
Copy link
Collaborator Author

Ryan Blue / @rdblue:
[~marki], thanks for opening this issue! I've actually been testing out Brotli lately with jbrotli and didn't realize there was already an issue for it. I just submitted HADOOP-13126 to add a codec to Hadoop and I'm going to post a PR for this issue soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant