-
Notifications
You must be signed in to change notification settings - Fork 6.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Compressed logs for keeper #29223
Compressed logs for keeper #29223
Conversation
For some reason zstd still argues, while keeper is able to read compressed logs:
|
|
@Mergifyio update |
Command
|
Ok, logs became much smaller. Now need to make snapshots compressed also with ZSTD (next PR). |
Discussed a bit in private chat. Need to fix some issue. |
BTW - why not LZ4? It's few times faster (quite important for logs) |
Simpler stream compression, good compression ratio (about x10), small amount of data. |
LZ4 is too fast for ZooKeeper logs. |
I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en
Changelog category (leave one):
Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):
Add
compress_logs
settings for clickhouse-keeper which allow to compress clickhouse-keeper logs inZSTD
. Implements: #26977.