Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Add support for Zstandard Compression #438
Hadoop added support for the Zstd compression library in version 2.9.0 https://issues.apache.org/jira/browse/HADOOP-13578
Zstandard was open source'd by Facebook a few years ago and looks like a nice improvement over gzip (better compression ratio and speed) and snappy (better compression ratio).
Tips for building Hadoop (I was able to build 2.9.0 on Fedora 27):