Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use at least 2 threads for xz compression #17

Merged
merged 1 commit into from Aug 3, 2020

Conversation

bmwiedemann
Copy link
Member

@bmwiedemann bmwiedemann commented Aug 1, 2020

PR #11 introduced compression depending on number of available CPUs,
but xz then produces different output on 1-core-VMs as seen with:
for n in 2 3 ; do echo | taskset $n xz --threads=0 -c - | md5sum ; done

See https://reproducible-builds.org/ for why this matters.

Edit: also discussing better solutions upstream: https://www.mail-archive.com/xz-devel@tukaani.org/msg00375.html

PR openSUSE#11 introduced compression depending on number of available CPUs,
but xz then produces different output on 1-core-VMs:
for n in 2 3 ; do echo | taskset $n xz --threads=0 -c - | md5sum ; done

See https://reproducible-builds.org/ for why this matters.
@adrianschroeter adrianschroeter merged commit f1b3103 into openSUSE:master Aug 3, 2020
@adrianschroeter
Copy link
Member

okay, still thinking this is a bug in xz in first place then though. But let's apply this workaround for now.

@bmwiedemann bmwiedemann deleted the cpu branch August 3, 2020 08:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants