Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

storage: add storage.sstable.compression_algorithm cluster setting #120784

Merged
merged 1 commit into from
Mar 21, 2024

Commits on Mar 21, 2024

  1. storage: add storage.sstable.compression_algorithm cluster setting

    Introduce a new cluster setting that allows the operator to configure the
    compression algorithm used when compressing sstable blocks. This allows
    operators to opt into use of zstd (as opposed to the previous setting of
    snappy). ZSTD typically achieves better compression ratios than snappy, and
    operators may find that they can achieve higher node densities through enabling
    zstd. Future releases may change the default compression algorithm.
    
    In a side-by-side comparison of a 10000-warehouse tpcc import, the zstd cluster
    achieved a higher import speed of 146 MiB/s versus snappy's 135 MiB/s. The zstd
    cluster's physical database size was significantly less.
    
    Epic: none
    Release note (ops change): Add `storage.sstable.compression_algorithm` cluster
    setting that configures the compression algorithm to use when compressing
    sstable blocks.
    jbowens committed Mar 21, 2024
    Configuration menu
    Copy the full SHA
    99f8a25 View commit details
    Browse the repository at this point in the history