Skip to content

Releases

uorc v0.6.0

Choose a tag to compare

@github-actions github-actions released this 14 Nov 11:26
e713d1c

uorc v0.6.0

Client: https://uor-foundation.github.io/compression/

Closed claims

Codec point eeee0a2f6b3c26d5 (export 99c7079bc1aa5fd3, plan portfolio, 1 lane). Sizes and decode steps are exact: each was decided by running this codec over the κ-named corpus and is recorded with its decision in the release's frontier.toml. A step is one model input evaluated for one coded bit.

corpus corpus κ input bytes archive bytes decode steps steps per byte status decided by
uorc-v0.3.0 9b781bfc9840 1442315 575285 198707536 137.77 proved factory
canterbury c97b3c539721 2810784 350393 474920872 168.96 proved factory
silesia 45094a500116 211938580 40900503 40067382768 189.05 proved factory

UC-PERF-01 target

On every public corpus, the archive is no larger than each pinned comparator's. A refuted row is a comparator this codec does not yet reach.

corpus comparator comparator bytes uorc bytes status
uorc-v0.3.0 gzip -9 650271 575285 proved
uorc-v0.3.0 bzip2 -9 606478 575285 proved
uorc-v0.3.0 xz -9e 595432 575285 proved
canterbury gzip -9 730625 350393 proved
canterbury bzip2 -9 542710 350393 proved
canterbury xz -9e 493080 350393 proved
canterbury zstd -19 --long 516216 350393 proved
canterbury brotli -q 11 490662 350393 proved
canterbury zpaq -m5 361718 350393 proved
canterbury 7z PPMd -mx9 575170 350393 proved
silesia gzip -9 67631918 40900503 proved
silesia bzip2 -9 54506769 40900503 proved
silesia xz -9e 48456004 40900503 proved
silesia zstd -19 --long 52646619 40900503 proved
silesia brotli -q 11 49564563 40900503 proved
silesia zpaq -m5 39112562 40900503 refuted
silesia 7z PPMd -mx9 47684624 40900503 proved

Distance to each requirement

Each requirement of Uorc.Performance derives a bound for this codec on each corpus; the row is what the run observed, the bound, and how far the observation is from it on the side the requirement forbids. A distance of 0 is the requirement met. Bytes and steps are exact and decided; rates are measured on the host named by its κ. leastArchive: the archive against the information the chosen model assigns to the input (what is left is the archive's form and the coder's rounding). wholeHost: per input, the longest chain of dependent decode steps against the total divided by the threads. hostCeiling: throughput against the input over the host's ceiling (Uorc.Host::ceilingNanos): the slower of the steps the run took (decode: the archive's exact steps; compress: the model steps every trial coded, uorc::ncm::model_steps) over the host's threads at the per-core step rate of the codec's own mixer contraction and the cache lines its tables move over the host's memory rate. The compute term covers the contraction only, so the distance includes the rest of each step; both sides count the archive's moved lines, a floor on what the compress trials move.

requirement quantity corpus at observed bound distance unit status
leastArchive archive bytes over the information the chosen model assigns uorc-v0.3.0 - 575285 574444 841 bytes proved
wholeHost longest chain of dependent decode steps over the total divided by the threads uorc-v0.3.0 4 threads (met up to 1) 198707536 49676884 149030652 steps proved
hostCeiling decompressed bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) uorc-v0.3.0 host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) 826314 11401593 10575279 bytes/s measured
hostCeiling compressed input bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) uorc-v0.3.0 host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) 75497 2153064 2077567 bytes/s measured
leastArchive archive bytes over the information the chosen model assigns canterbury - 350393 349228 1165 bytes proved
wholeHost longest chain of dependent decode steps over the total divided by the threads canterbury 4 threads (met up to 1) 474920872 118730218 356190654 steps proved
hostCeiling decompressed bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) canterbury host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) 827217 9190916 8363699 bytes/s measured
hostCeiling compressed input bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) canterbury host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) 103909 1995499 1891590 bytes/s measured
leastArchive archive bytes over the information the chosen model assigns silesia - 40900503 40896951 3552 bytes proved
wholeHost longest chain of dependent decode steps over the total divided by the threads silesia 4 threads (met up to 1) 35179213488 10016845692 25162367796 steps proved
hostCeiling decompressed bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) silesia host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) 800801 7790846 6990045 bytes/s measured
hostCeiling compressed input bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) silesia host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) 143624 2218440 2074816 bytes/s measured
Per family (first claim's corpus)
family members archive bytes decode steps
tiny 2 1475 631296
small 2 2479 6441216
text 3 259504 162957848
other 1 311827 28677176

The register holds 42 claims over 3 corpora and 3 codec points; 10 concern other points (earlier releases, engine candidates) and are kept by κ, never rerun.

The model on the page

Performance rows: UC-PERF-01 (benchmark_target_unmet), UC-PERF-02 (kernel_theorem), UC-PERF-03 (kernel_theorem), UC-PERF-04 (kernel_theorem), UC-PERF-05 (kernel_theorem), UC-PERF-06 (kernel_theorem), UC-PERF-07 (kernel_theorem), UC-PERF-08 (kernel_theorem), UC-PERF-09 (kernel_theorem), UC-PERF-10 (kernel_theorem), UC-PERF-11 (build_evidence), UC-PERF-16 (build_evidence), UC-PERF-17 (build_evidence).

Claims: 42 recorded, 35 proved, 1 refuted (listed above).

Engine: tick 0, rule30 register 0x9e3779b97f4a7c15, 10 strategies in the portfolio, 70 weights.

The full register is model.json, on the Pages site and attached to this release.

uorc benchmarks

uorc 0.6.0, 0 search steps per file, linux/x64. Measurement only; no target is set.

Machine ceiling: 4 cores (Intel(R) Xeon(R) 6975P-C), 15.3 GiB memory; memory copy 14966 MB/s on one core and 18694 MB/s on all 4. A decoder cannot write its output faster than the machine copies memory, so the last column is decompress throughput as a share of the all-core copy rate. uorc uses every core (8 MiB frames in parallel); the other tools run with their default thread settings.

canterbury

compressor files archive bytes ratio compress MB/s decompress MB/s decompress / copy
uorc (0 steps) 11 350393 8.022 0.12 0.64 0.0034%
gzip -9 11 730625 3.847 5.30 81.15 0.43%
bzip2 -9 11 542710 5.179 20.39 39.16 0.21%
xz -9e 11 493080 5.700 1.84 57.50 0.31%
zstd -19 --long 11 516216 5.445 1.92 86.40 0.46%
brotli -q 11 11 490662 5.729 0.73 83.33 0.45%
zpaq -m5 11 361718 7.771 0.61 0.60 0.0032%
7z PPMd -mx9 11 575170 4.887 10.44 10.06 0.054%
Per file (archive bytes)
file bytes uorc (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11 zpaq -m5 7z PPMd -mx9
alice29.txt 152089 37151 54179 43202 48528 49212 46487 37591 38956
asyoulik.txt 125179 34553 48816 39569 44592 45138 42712 35369 38434
cp.html 24603 6351 7973 7624 7652 7716 6894 7418 7507
fields.c 11150 2402 3127 3039 3032 3017 2717 3469 3110
grammar.lsp 3721 1064 1234 1283 1292 1214 1124 2069 1326
kennedy.xls 1029744 13895 209721 130280 51868 64826 61498 16813 182238
lcet10.txt 426754 89314 144418 107706 119488 121337 113416 90013 102503
plrabn12.txt 481861 127081 194264 145577 165456 167439 163267 127568 138560
ptt5 513216 28280 52377 49759 39860 43610 40939 28561 48463
sum 38240 8943 12768 12909 9500 10978 10144 10324 12417
xargs.1 4227 1359 1748 1762 1812 1729 1464 2523 1656

silesia

compressor files archive bytes ratio compress MB/s decompress MB/s decompress / copy
uorc (0 steps) 12 40900503 5.182 0.16 0.88 0.0047%
gzip -9 12 67631918 3.134 12.74 171.52 0.92%
bzip2 -9 12 54506769 3.888 16.03 34.36 0.18%
xz -9e 12 48456004 4.374 2.10 81.82 0.44%
zstd -19 --long 12 52646619 4.026 2.97 463.93 2.5%
brotli -q 11 12 49564563 4.276 0.60 246.53 1.3%
zpaq -m5 12 39112562 5.419 0.57 0.56 0.0030%
7z PPMd -mx9 12 47684624 4.445 7.82 7.24 0.039%
Per file (archive bytes)

| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9...

Read more

uorc v0.5.0

Choose a tag to compare

@github-actions github-actions released this 13 Nov 15:48
5aeeb04

uorc v0.5.0

Client: https://uor-foundation.github.io/compression/

Closed claims

Codec point 3cd4e997c1460e85 (export 6b5653bf17c4f34e, plan portfolio, 1 lane). Sizes and decode steps are exact: each was decided by running this codec over the κ-named corpus and is recorded with its decision in the release's frontier.toml. A step is one model input evaluated for one coded bit.

corpus corpus κ input bytes archive bytes decode steps steps per byte status decided by
uorc-v0.3.0 9b781bfc9840 1442315 575439 198707536 137.77 proved factory
canterbury c97b3c539721 2810784 351887 474920872 168.96 proved factory
silesia 45094a500116 211938580 40987562 40067382768 189.05 proved factory

UC-PERF-01 target

On every public corpus, the archive is no larger than each pinned comparator's. A refuted row is a comparator this codec does not yet reach.

corpus comparator comparator bytes uorc bytes status
uorc-v0.3.0 gzip -9 650271 575439 proved
uorc-v0.3.0 bzip2 -9 606478 575439 proved
uorc-v0.3.0 xz -9e 595432 575439 proved
canterbury gzip -9 730625 351887 proved
canterbury bzip2 -9 542710 351887 proved
canterbury xz -9e 493080 351887 proved
canterbury zstd -19 --long 516216 351887 proved
canterbury brotli -q 11 490662 351887 proved
canterbury zpaq -m5 361718 351887 proved
canterbury 7z PPMd -mx9 575170 351887 proved
silesia gzip -9 67631918 40987562 proved
silesia bzip2 -9 54506769 40987562 proved
silesia xz -9e 48456004 40987562 proved
silesia zstd -19 --long 52646619 40987562 proved
silesia brotli -q 11 49564563 40987562 proved
silesia zpaq -m5 39112562 40987562 refuted
silesia 7z PPMd -mx9 47684624 40987562 proved
Per family (first claim's corpus)
family members archive bytes decode steps
tiny 2 1475 631296
small 2 2487 6441216
text 3 259617 162957848
other 1 311860 28677176

The register holds 24 claims over 3 corpora and 2 codec points; 4 concern other points (earlier releases, engine candidates) and are kept by κ, never rerun.

The model on the page

Performance rows: UC-PERF-01 (benchmark_target_unmet), UC-PERF-02 (kernel_theorem), UC-PERF-03 (kernel_theorem), UC-PERF-04 (kernel_theorem), UC-PERF-05 (kernel_theorem), UC-PERF-06 (kernel_theorem), UC-PERF-07 (kernel_theorem), UC-PERF-08 (kernel_theorem), UC-PERF-09 (kernel_theorem), UC-PERF-10 (kernel_theorem), UC-PERF-11 (build_evidence), UC-PERF-16 (build_evidence), UC-PERF-17 (build_evidence).

Claims: 24 recorded, 23 proved, 1 refuted (listed above).

Engine: tick 0, rule30 register 0x9e3779b97f4a7c15, 10 strategies in the portfolio, 70 weights.

The full register is model.json, on the Pages site and attached to this release.

uorc benchmarks

uorc 0.5.0, 0 search steps per file, linux/x64. Measurement only; no target is set.

Machine ceiling: 4 cores (AMD EPYC 7763 64-Core Processor), 15.6 GiB memory; memory copy 20202 MB/s on one core and 22474 MB/s on all 4. A decoder cannot write its output faster than the machine copies memory, so the last column is decompress throughput as a share of the all-core copy rate. uorc uses every core (8 MiB frames in parallel); the other tools run with their default thread settings.

canterbury

compressor files archive bytes ratio compress MB/s decompress MB/s decompress / copy
uorc (0 steps) 11 350645 8.016 0.07 0.39 0.0018%
gzip -9 11 730625 3.847 4.22 61.92 0.28%
bzip2 -9 11 542710 5.179 15.73 26.62 0.12%
xz -9e 11 493080 5.700 1.67 39.79 0.18%
zstd -19 --long 11 516216 5.445 1.37 57.55 0.26%
brotli -q 11 11 490662 5.729 0.56 58.66 0.26%
zpaq -m5 11 361718 7.771 0.38 0.38 0.0017%
7z PPMd -mx9 11 575170 4.887 7.26 7.35 0.033%
Per file (archive bytes)
file bytes uorc (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11 zpaq -m5 7z PPMd -mx9
alice29.txt 152089 37158 54179 43202 48528 49212 46487 37591 38956
asyoulik.txt 125179 34559 48816 39569 44592 45138 42712 35369 38434
cp.html 24603 6351 7973 7624 7652 7716 6894 7418 7507
fields.c 11150 2402 3127 3039 3032 3017 2717 3469 3110
grammar.lsp 3721 1064 1234 1283 1292 1214 1124 2069 1326
kennedy.xls 1029744 14093 209721 130280 51868 64826 61498 16813 182238
lcet10.txt 426754 89314 144418 107706 119488 121337 113416 90013 102503
plrabn12.txt 481861 127122 194264 145577 165456 167439 163267 127568 138560
ptt5 513216 28280 52377 49759 39860 43610 40939 28561 48463
sum 38240 8943 12768 12909 9500 10978 10144 10324 12417
xargs.1 4227 1359 1748 1762 1812 1729 1464 2523 1656

silesia

compressor files archive bytes ratio compress MB/s decompress MB/s decompress / copy
uorc (0 steps) 12 40925775 5.179 0.10 0.62 0.0027%
gzip -9 12 67631918 3.134 10.77 145.02 0.65%
bzip2 -9 12 54506769 3.888 13.09 28.83 0.13%
xz -9e 12 48456004 4.374 1.94 63.93 0.28%
zstd -19 --long 12 52646619 4.026 2.24 321.88 1.4%
brotli -q 11 12 49564563 4.276 0.49 214.91 0.96%
zpaq -m5 12 39112562 5.419 0.40 0.40 0.0018%
7z PPMd -mx9 12 47684624 4.445 6.49 6.05 0.027%
Per file (archive bytes)
file bytes uorc (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11 zpaq -m5 7z PPMd -mx9
dickens 10192446 2240481 3851815 2799520 2831212 2849320 2827777 2094743 2280117
mozilla 51220480 12587898 18994134 17914392 13376240 14978836 13872265 12041055 15911894
mr 9970564 2158855 3673937 2441280 2751892 3105810 2823136 2181310 2320767
nci 33553445 1387073 2987529 1812734 1449272 1615898 1519768 1251108 1484569
ooffice 6152192 1794476 3090434 2862526 2427224 2595308 2478855 1766550 2496131
osdb 10085684 2225316 3716337 2802792 2844556 3099934 2816278 2204741 2384175
reymont 6627202 1007520 1820826 1246230 1315592 1348541 1332158 956499 1054291
samba 21606400 3169580 5408266 4549759 3739524 3876656 3766340 3053820 3815315
sao 7251944 3979521 5327037 4940524 4425664 5000573 4586092 3899258 4783825
webster 41458703 6392659 12061616 8644714 8368672 8592754 8428575 5666831 6942883
x-ray 8474240 3653386 6037707 4051112 4491264 5129825 4682753 3669701 3850893
xml 5345280 329010 662280 441186 434892 453164 430566 326946 359764

Ratio is input bytes over archive bytes, and throughput is input MB per second, both over the files that compressor round-tripped. ✗ marks a failed round trip. zpaq and 7z archive bytes include their container headers. Tool versions:

  • gzip -9: gzip 1.12
  • bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
  • xz -9e: xz (XZ Utils) 5.4.5
  • zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
  • brotli -q 11: brotli 1.1.0
  • zpaq -m5: zpaq v7.15 journaling archiver, compiled Jan 5 2021
  • 7z PPMd -mx9: 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20

Benchmark corpora

Benchmark corpora Pre-release
Pre-release

Choose a tag to compare

@github-actions github-actions released this 13 Nov 12:57
5aeeb04

Benchmark corpora pinned by frontier.toml (sha256 per member), mirrored by scripts/corpora.mjs so a corpus host refusing a runner cannot fail a release. Not a uorc release.

uorc v0.4.0

Choose a tag to compare

@github-actions github-actions released this 11 Nov 14:21
fc151ec

uorc v0.4.0

Client: https://uor-foundation.github.io/compression/

uorc benchmarks

uorc 0.4.0, 0 search steps per file, linux/x64. Measurement only; no target is set.

Machine ceiling: 4 cores (AMD EPYC 9V74 80-Core Processor), 15.6 GiB memory; memory copy 16366 MB/s on one core and 26526 MB/s on all 4. A decoder cannot write its output faster than the machine copies memory, so the last column is decompress throughput as a share of the all-core copy rate. uorc uses every core (8 MiB frames in parallel); the other tools run with their default thread settings.

canterbury

compressor files archive bytes ratio compress MB/s decompress MB/s decompress / copy
uorc (0 steps) 11 352806 7.967 0.30 0.65 0.0025%
gzip -9 11 730625 3.847 4.93 70.66 0.27%
bzip2 -9 11 542710 5.179 19.21 33.23 0.13%
xz -9e 11 493080 5.700 1.89 49.03 0.18%
zstd -19 --long 11 516216 5.445 1.68 62.90 0.24%
brotli -q 11 11 490662 5.729 0.71 68.89 0.26%
zpaq -m5 11 361718 7.771 0.50 0.49 0.0019%
7z PPMd -mx9 11 575170 4.887 8.33 8.25 0.031%
Per file (archive bytes)
file bytes uorc (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11 zpaq -m5 7z PPMd -mx9
alice29.txt 152089 37189 54179 43202 48528 49212 46487 37591 38956
asyoulik.txt 125179 34665 48816 39569 44592 45138 42712 35369 38434
cp.html 24603 6485 7973 7624 7652 7716 6894 7418 7507
fields.c 11150 2529 3127 3039 3032 3017 2717 3469 3110
grammar.lsp 3721 1098 1234 1283 1292 1214 1124 2069 1326
kennedy.xls 1029744 14179 209721 130280 51868 64826 61498 16813 182238
lcet10.txt 426754 90134 144418 107706 119488 121337 113416 90013 102503
plrabn12.txt 481861 127695 194264 145577 165456 167439 163267 127568 138560
ptt5 513216 28342 52377 49759 39860 43610 40939 28561 48463
sum 38240 8944 12768 12909 9500 10978 10144 10324 12417
xargs.1 4227 1546 1748 1762 1812 1729 1464 2523 1656

silesia

compressor files archive bytes ratio compress MB/s decompress MB/s decompress / copy
uorc (0 steps) 12 41003375 5.169 0.49 0.75 0.0028%
gzip -9 12 67631918 3.134 11.88 168.58 0.64%
bzip2 -9 12 54506769 3.888 15.98 35.08 0.13%
xz -9e 12 48456004 4.374 2.06 77.98 0.29%
zstd -19 --long 12 52646619 4.026 2.64 388.61 1.5%
brotli -q 11 12 49564563 4.276 0.60 244.70 0.92%
zpaq -m5 12 39112562 5.419 0.50 0.50 0.0019%
7z PPMd -mx9 12 47684624 4.445 6.75 6.37 0.024%
Per file (archive bytes)
file bytes uorc (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11 zpaq -m5 7z PPMd -mx9
dickens 10192446 2242072 3851815 2799520 2831212 2849320 2827777 2094743 2280117
mozilla 51220480 12611789 18994134 17914392 13376240 14978836 13872265 12041055 15911894
mr 9970564 2161741 3673937 2441280 2751892 3105810 2823136 2181310 2320767
nci 33553445 1389780 2987529 1812734 1449272 1615898 1519768 1251108 1484569
ooffice 6152192 1800251 3090434 2862526 2427224 2595308 2478855 1766550 2496131
osdb 10085684 2227043 3716337 2802792 2844556 3099934 2816278 2204741 2384175
reymont 6627202 1007649 1820826 1246230 1315592 1348541 1332158 956499 1054291
samba 21606400 3183192 5408266 4549759 3739524 3876656 3766340 3053820 3815315
sao 7251944 3980702 5327037 4940524 4425664 5000573 4586092 3899258 4783825
webster 41458703 6411381 12061616 8644714 8368672 8592754 8428575 5666831 6942883
x-ray 8474240 3656010 6037707 4051112 4491264 5129825 4682753 3669701 3850893
xml 5345280 331765 662280 441186 434892 453164 430566 326946 359764

Ratio is input bytes over archive bytes, and throughput is input MB per second, both over the files that compressor round-tripped. ✗ marks a failed round trip. zpaq and 7z archive bytes include their container headers. Tool versions:

  • gzip -9: gzip 1.12
  • bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
  • xz -9e: xz (XZ Utils) 5.4.5
  • zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
  • brotli -q 11: brotli 1.1.0
  • zpaq -m5: zpaq v7.15 journaling archiver, compiled Jan 5 2021
  • 7z PPMd -mx9: 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20

uorc v0.3.0

Choose a tag to compare

@github-actions github-actions released this 10 Nov 20:15
a4e2222

uorc v0.3.0

Client: https://uor-foundation.github.io/compression/

uorc benchmarks

uorc 0.3.0, 0 search steps per file, linux/x64. Measurement only; no target is set.

Machine ceiling: 4 cores (AMD EPYC 9V45 96-Core Processor), 15.6 GiB memory; memory copy 22804 MB/s on one core and 28241 MB/s on all 4. A decoder cannot write its output faster than the machine copies memory, so the last column is decompress throughput as a share of the all-core copy rate. uorc uses every core (8 MiB frames in parallel); the other tools run with their default thread settings.

canterbury

compressor files archive bytes ratio compress MB/s decompress MB/s decompress / copy
uorc (0 steps) 11 355559 7.905 0.71 0.63 0.0022%
gzip -9 11 730625 3.847 5.99 66.93 0.24%
bzip2 -9 11 542710 5.179 20.77 35.36 0.13%
xz -9e 11 493080 5.700 2.07 49.31 0.17%
zstd -19 --long 11 516216 5.445 1.89 69.32 0.25%
brotli -q 11 11 490662 5.729 0.82 68.20 0.24%
zpaq -m5 11 361718 7.771 0.54 0.56 0.0020%
7z PPMd -mx9 11 575170 4.887 8.53 9.18 0.033%
Per file (archive bytes)
file bytes uorc (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11 zpaq -m5 7z PPMd -mx9
alice29.txt 152089 37321 54179 43202 48528 49212 46487 37591 38956
asyoulik.txt 125179 34701 48816 39569 44592 45138 42712 35369 38434
cp.html 24603 6485 7973 7624 7652 7716 6894 7418 7507
fields.c 11150 2531 3127 3039 3032 3017 2717 3469 3110
grammar.lsp 3721 1098 1234 1283 1292 1214 1124 2069 1326
kennedy.xls 1029744 14838 209721 130280 51868 64826 61498 16813 182238
lcet10.txt 426754 90869 144418 107706 119488 121337 113416 90013 102503
plrabn12.txt 481861 128152 194264 145577 165456 167439 163267 127568 138560
ptt5 513216 28972 52377 49759 39860 43610 40939 28561 48463
sum 38240 9046 12768 12909 9500 10978 10144 10324 12417
xargs.1 4227 1546 1748 1762 1812 1729 1464 2523 1656

silesia

compressor files archive bytes ratio compress MB/s decompress MB/s decompress / copy
uorc (0 steps) 12 41726363 5.079 1.21 0.87 0.0031%
gzip -9 12 67631918 3.134 14.54 186.90 0.66%
bzip2 -9 12 54506769 3.888 17.78 41.28 0.15%
xz -9e 12 48456004 4.374 2.15 81.58 0.29%
zstd -19 --long 12 52646619 4.026 2.75 437.72 1.5%
brotli -q 11 12 49564563 4.276 0.69 261.69 0.93%
zpaq -m5 12 39112562 5.419 0.57 0.55 0.0020%
7z PPMd -mx9 12 47684624 4.445 6.74 6.32 0.022%
Per file (archive bytes)
file bytes uorc (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11 zpaq -m5 7z PPMd -mx9
dickens 10192446 2254587 3851815 2799520 2831212 2849320 2827777 2094743 2280117
mozilla 51220480 12869415 18994134 17914392 13376240 14978836 13872265 12041055 15911894
mr 9970564 2186070 3673937 2441280 2751892 3105810 2823136 2181310 2320767
nci 33553445 1448680 2987529 1812734 1449272 1615898 1519768 1251108 1484569
ooffice 6152192 1839225 3090434 2862526 2427224 2595308 2478855 1766550 2496131
osdb 10085684 2283845 3716337 2802792 2844556 3099934 2816278 2204741 2384175
reymont 6627202 1026475 1820826 1246230 1315592 1348541 1332158 956499 1054291
samba 21606400 3276175 5408266 4549759 3739524 3876656 3766340 3053820 3815315
sao 7251944 3996589 5327037 4940524 4425664 5000573 4586092 3899258 4783825
webster 41458703 6500821 12061616 8644714 8368672 8592754 8428575 5666831 6942883
x-ray 8474240 3706874 6037707 4051112 4491264 5129825 4682753 3669701 3850893
xml 5345280 337607 662280 441186 434892 453164 430566 326946 359764

Ratio is input bytes over archive bytes, and throughput is input MB per second, both over the files that compressor round-tripped. ✗ marks a failed round trip. zpaq and 7z archive bytes include their container headers. Tool versions:

  • gzip -9: gzip 1.12
  • bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
  • xz -9e: xz (XZ Utils) 5.4.5
  • zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
  • brotli -q 11: brotli 1.1.0
  • zpaq -m5: zpaq v7.15 journaling archiver, compiled Jan 5 2021
  • 7z PPMd -mx9: 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20

uorc v0.2.0

Choose a tag to compare

@github-actions github-actions released this 10 Nov 05:05
3ba0dc4

uorc v0.2.0

Client: https://uor-foundation.github.io/compression/

uorc benchmarks

uorc 0.1.0, 0 search steps per file, linux/x64. Measurement only; no target is set.

canterbury

compressor files archive bytes ratio compress MB/s decompress MB/s
uorc (0 steps) 11 551058 5.101 16.49 51.78
uorc --best (0 steps) 11 355559 7.905 0.35 0.73
gzip -9 11 730625 3.847 6.37 100.39
bzip2 -9 11 542710 5.179 23.47 41.01
xz -9e 11 493080 5.700 2.62 65.64
zstd -19 --long 11 516216 5.445 2.18 88.17
brotli -q 11 11 490662 5.729 0.93 99.03
Per file (archive bytes)
file bytes uorc (0 steps) uorc --best (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11
alice29.txt 152089 52002 37321 54179 43202 48528 49212 46487
asyoulik.txt 125179 47311 34701 48816 39569 44592 45138 42712
cp.html 24603 7968 6485 7973 7624 7652 7716 6894
fields.c 11150 3152 2531 3127 3039 3032 3017 2717
grammar.lsp 3721 1347 1098 1234 1283 1292 1214 1124
kennedy.xls 1029744 61507 14838 209721 130280 51868 64826 61498
lcet10.txt 426754 130788 90869 144418 107706 119488 121337 113416
plrabn12.txt 481861 180903 128152 194264 145577 165456 167439 163267
ptt5 513216 53254 28972 52377 49759 39860 43610 40939
sum 38240 10954 9046 12768 12909 9500 10978 10144
xargs.1 4227 1872 1546 1748 1762 1812 1729 1464

silesia

compressor files archive bytes ratio compress MB/s decompress MB/s
uorc (0 steps) 12 57167560 3.707 11.03 56.58
uorc --best (0 steps) 12 42331696 5.007 0.54 0.74
gzip -9 12 67631918 3.134 15.66 203.05
bzip2 -9 12 54506769 3.888 19.45 44.42
xz -9e 12 48456004 4.374 2.81 91.35
zstd -19 --long 12 52646619 4.026 3.74 512.44
brotli -q 11 12 49564563 4.276 0.79 316.96
Per file (archive bytes)
file bytes uorc (0 steps) uorc --best (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11
dickens 10192446 3375931 2266775 3851815 2799520 2831212 2849320 2827777
mozilla 51220480 15493734 12972784 18994134 17914392 13376240 14978836 13872265
mr 9970564 3129345 2189830 3673937 2441280 2751892 3105810 2823136
nci 33553445 2249012 1471159 2987529 1812734 1449272 1615898 1519768
ooffice 6152192 2699360 2130028 3090434 2862526 2427224 2595308 2478855
osdb 10085684 3356987 2290527 3716337 2802792 2844556 3099934 2816278
reymont 6627202 1696532 1026475 1820826 1246230 1315592 1348541 1332158
samba 21606400 4298090 3333282 5408266 4549759 3739524 3876656 3766340
sao 7251944 4933351 3996589 5327037 4940524 4425664 5000573 4586092
webster 41458703 10327487 6609767 12061616 8644714 8368672 8592754 8428575
x-ray 8474240 5077000 3706873 6037707 4051112 4491264 5129825 4682753
xml 5345280 530731 337607 662280 441186 434892 453164 430566

Ratio is input bytes over archive bytes, and throughput is input MB per second, both over the files that compressor round-tripped. ✗ marks a failed round trip. Tool versions:

  • gzip -9: gzip 1.12
  • bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
  • xz -9e: xz (XZ Utils) 5.4.5
  • zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
  • brotli -q 11: brotli 1.1.0

uorc v0.1.0

Choose a tag to compare

@github-actions github-actions released this 09 Nov 20:52

uorc v0.1.0

Client: https://uor-foundation.github.io/compression/

uorc benchmark: canterbury

uorc 0.1.0, 0 search steps per file, linux/x64. Measurement only; no target is set.

file bytes uorc (0 steps) gzip -9 bzip2 -9 xz -9e zstd -19 --long brotli -q 11
alice29.txt 152089 55563 54179 43202 48528 49212 46487
asyoulik.txt 125179 50593 48816 39569 44592 45138 42712
cp.html 24603 10517 7973 7624 7652 7716 6894
fields.c 11150 5711 3127 3039 3032 3017 2717
grammar.lsp 3721 3766 1234 1283 1292 1214 1124
kennedy.xls 1029744 64536 209721 130280 51868 64826 61498
lcet10.txt 426754 137548 144418 107706 119488 121337 113416
plrabn12.txt 481861 190125 194264 145577 165456 167439 163267
ptt5 513216 56083 52377 49759 39860 43610 40939
sum 38240 13620 12768 12909 9500 10978 10144
xargs.1 4227 4272 1748 1762 1812 1729 1464
total 2810784 592334 730625 542710 493080 516216 490662

Archive sizes in bytes; ✗ marks a failed round trip. Tool versions:

  • gzip -9: gzip 1.12
  • bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
  • xz -9e: xz (XZ Utils) 5.4.5
  • zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
  • brotli -q 11: brotli 1.1.0