Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

zstd 1.5.6 #167271

Merged
merged 2 commits into from Mar 27, 2024
Merged

zstd 1.5.6 #167271

merged 2 commits into from Mar 27, 2024

Conversation

BrewTestBot
Copy link
Member

Created by brew bump

Created with brew bump-formula-pr.

release notes 
This release highlights the deployment of Google [Chrome 123](https://developer.chrome.com/blog/new-in-chrome-123), introducing `zstd-encoding` for Web traffic, introduced as a preferable option for compression of dynamic contents. With limited web server support for `zstd-encoding` due to its novelty, we are launching an updated Zstandard version to facilitate broader adoption.

New stable parameter ZSTD_c_targetCBlockSize


Using zstd compression for large documents over the Internet, data is segmented into smaller blocks of up to 128 KB, for incremental updates. This is crucial for applications like Chrome that process parts of documents as they arrive. However, on slow or congested networks, there can be some brief unresponsiveness in the middle of a block transmission, delaying update. To mitigate such scenarios, libzstd introduces the new parameter ZSTD_c_targetCBlockSize, enabling the division of blocks into even smaller segments to enhance initial byte delivery speed. Activating this feature incurs a cost, both runtime (equivalent to -2% speed at level 8) and a slight compression efficiency decrease (<0.1%), but offers some interesting latency reduction, notably beneficial in areas with less powerful network infrastructure.


Granular binary size selection


libzstd provides build customization, including options to compile only the compression or decompression modules, minimizing binary size. Enhanced in v1.5.6 (source), it now allows for even finer control by enabling selective inclusion or exclusion of specific components within these modules. This advancement aids applications needing precise binary size management.


Miscellaneous Enhancements


This release includes various minor enhancements and bug fixes to enhance user experience. Key updates include an expanded list of recognized compressed file suffixes for the --exclude-compressed flag, improving efficiency by skipping presumed incompressible content. Furthermore, compatibility has been broadened to include additional chipsets (sparc64, ARM64EC, risc-v) and operating systems (QNX, AIX, Solaris, HP-UX).


Change Log


api: Promote ZSTD_c_targetCBlockSize to Stable API by @felixhandte

api: new experimental ZSTD_d_maxBlockSize parameter, to reduce streaming decompression memory, by @terrelln

perf: improve performance of param ZSTD_c_targetCBlockSize, by @Cyan4973

perf: improved compression of arrays of integers at high compression, by @Cyan4973

lib: reduce binary size with selective built-time exclusion, by @felixhandte

lib: improved huffman speed on small data and linux kernel, by @terrelln

lib: accept dictionaries with partial literal tables, by @terrelln

lib: fix CCtx size estimation with external sequence producer, by @embg

lib: fix corner case decoder behaviors, by @Cyan4973 and @aimuz

lib: fix zdict prototype mismatch in static_only mode, by @ldv-alt

lib: fix several bugs in magicless-format decoding, by @embg

cli: add common compressed file types to --exclude-compressed by @daniellerozenblit (requested by @dcog989)

cli: fix mixing -c and -o commands with --rm, by @Cyan4973

cli: fix erroneous exclusion of hidden files with --output-dir-mirror by @felixhandte

cli: improved time accuracy on BSD, by @felixhandte

cli: better errors on argument parsing, by @KapJI

tests: better compatibility with older versions of grep, by @Cyan4973

tests: lorem ipsum generator as default content generator, by @Cyan4973

build: cmake improvements by @terrelln, @sighingnow, @gjasny, @JohanMabille, @Saverio976, @gruenich, @teo-tsirpanis

build: bazel support, by @jondo2010

build: fix cross-compiling for AArch64 with lld by @jcelerier

build: fix Apple platform compatibility, by @nidhijaju

build: fix Visual 2012 and lower compatibility, by @Cyan4973

build: improve win32 support, by @DimitriPapadopoulos

build: better C90 compliance for zlibWrapper, by @emaste

port: make: fat binaries on macos, by @mredig

port: ARM64EC compatibility for Windows, by @dunhor

port: QNX support by @klausholstjacobsen

port: MSYS2 and Cygwin makefile installation and test support, by @QBos07

port: risc-v support validation in CI, by @Cyan4973

port: sparc64 support validation in CI, by @Cyan4973

port: AIX compatibility, by @likema

port: HP-UX compatibility, by @likema

doc: Improved specification accuracy, by @elasota

bug: Fix and deprecate ZSTD_generateSequences (#3981), by @terrelln


Full change list (auto-generated)



New Contributors



Full Changelog: facebook/zstd@v1.5.5...v1.5.6

@github-actions github-actions bot added bump-formula-pr PR was created using `brew bump-formula-pr` CI-linux-self-hosted Build on Linux self-hosted runner long build Needs CI-long-timeout labels Mar 27, 2024
@chenrui333 chenrui333 added the CI-skip-recursive-dependents Pass --skip-recursive-dependents to brew test-bot. label Mar 27, 2024
@fxcoudert fxcoudert added the CI-long-timeout Use longer GitHub Actions CI timeout. label Mar 27, 2024
@github-actions github-actions bot removed the CI-long-timeout Use longer GitHub Actions CI timeout. label Mar 27, 2024
@github-actions GitHub Actions
Copy link
Contributor

🤖 An automated task has requested bottles to be published to this PR.

@github-actions github-actions bot added the CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. label Mar 27, 2024
@BrewTestBot BrewTestBot added this pull request to the merge queue Mar 27, 2024
Merged via the queue into master with commit 00fdea4 Mar 27, 2024
14 checks passed
@BrewTestBot BrewTestBot deleted the bump-zstd-1.5.6 branch March 27, 2024 10:12
@github-actions github-actions bot added the outdated PR was locked due to age label Apr 28, 2024
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Apr 28, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers

@miccal miccal miccal approved these changes

@github-actions github-actions[bot] github-actions approved these changes

Assignees
No one assigned
Labels
bump-formula-pr PR was created using `brew bump-formula-pr` CI-linux-self-hosted Build on Linux self-hosted runner CI-published-bottle-commits The commits for the built bottles have been pushed to the PR branch. CI-skip-recursive-dependents Pass --skip-recursive-dependents to brew test-bot. long build Needs CI-long-timeout outdated PR was locked due to age
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

None yet
4 participants
@BrewTestBot @miccal @chenrui333 @fxcoudert