New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Compression ratio is better after tweaking quality 6 -> 1 for big files #222
Comments
Tested on a 2.79GB file, results are same. Every line in the file looks like the following one:
|
Are these sorted 64-bit hashes? |
Yes, you can say that, @jyrkialakuijala. |
I have identified a problem in the hashing that degrades the compression performance after 2 GB for quality >= 5. We will fix this within three days. |
Sure, thanks. |
Levels 5-9 should work in the head now. Level 11, the same as 10, is still misbehaving for files longer than 2 GB. |
As mentioned in previous comment, should be fixed now. |
I have a ~30GB text file filled with ascii numbers.
If I truncate to first 1GB, brotli outperforms gzip in size about ~20%.
However, if I compress the whole file with quality 1, brotli compressed file is only 8% smaller.
More strange, if I compress the whole file with quality 6, brotli compressed file is actually 11% bigger than gzip.
Any theory what is going on? Thanks.
The text was updated successfully, but these errors were encountered: