Repository navigation
Releases
uorc v0.6.0
uorc v0.6.0
Client: https://uor-foundation.github.io/compression/
Closed claims
Codec point eeee0a2f6b3c26d5 (export 99c7079bc1aa5fd3, plan portfolio, 1 lane). Sizes and decode steps are exact: each was decided by running this codec over the κ-named corpus and is recorded with its decision in the release's frontier.toml. A step is one model input evaluated for one coded bit.
| corpus | corpus κ | input bytes | archive bytes | decode steps | steps per byte | status | decided by |
|---|---|---|---|---|---|---|---|
| uorc-v0.3.0 | 9b781bfc9840 |
1442315 | 575285 | 198707536 | 137.77 | proved | factory |
| canterbury | c97b3c539721 |
2810784 | 350393 | 474920872 | 168.96 | proved | factory |
| silesia | 45094a500116 |
211938580 | 40900503 | 40067382768 | 189.05 | proved | factory |
UC-PERF-01 target
On every public corpus, the archive is no larger than each pinned comparator's. A refuted row is a comparator this codec does not yet reach.
| corpus | comparator | comparator bytes | uorc bytes | status |
|---|---|---|---|---|
| uorc-v0.3.0 | gzip -9 | 650271 | 575285 | proved |
| uorc-v0.3.0 | bzip2 -9 | 606478 | 575285 | proved |
| uorc-v0.3.0 | xz -9e | 595432 | 575285 | proved |
| canterbury | gzip -9 | 730625 | 350393 | proved |
| canterbury | bzip2 -9 | 542710 | 350393 | proved |
| canterbury | xz -9e | 493080 | 350393 | proved |
| canterbury | zstd -19 --long | 516216 | 350393 | proved |
| canterbury | brotli -q 11 | 490662 | 350393 | proved |
| canterbury | zpaq -m5 | 361718 | 350393 | proved |
| canterbury | 7z PPMd -mx9 | 575170 | 350393 | proved |
| silesia | gzip -9 | 67631918 | 40900503 | proved |
| silesia | bzip2 -9 | 54506769 | 40900503 | proved |
| silesia | xz -9e | 48456004 | 40900503 | proved |
| silesia | zstd -19 --long | 52646619 | 40900503 | proved |
| silesia | brotli -q 11 | 49564563 | 40900503 | proved |
| silesia | zpaq -m5 | 39112562 | 40900503 | refuted |
| silesia | 7z PPMd -mx9 | 47684624 | 40900503 | proved |
Distance to each requirement
Each requirement of Uorc.Performance derives a bound for this codec on each corpus; the row is what the run observed, the bound, and how far the observation is from it on the side the requirement forbids. A distance of 0 is the requirement met. Bytes and steps are exact and decided; rates are measured on the host named by its κ. leastArchive: the archive against the information the chosen model assigns to the input (what is left is the archive's form and the coder's rounding). wholeHost: per input, the longest chain of dependent decode steps against the total divided by the threads. hostCeiling: throughput against the input over the host's ceiling (Uorc.Host::ceilingNanos): the slower of the steps the run took (decode: the archive's exact steps; compress: the model steps every trial coded, uorc::ncm::model_steps) over the host's threads at the per-core step rate of the codec's own mixer contraction and the cache lines its tables move over the host's memory rate. The compute term covers the contraction only, so the distance includes the rest of each step; both sides count the archive's moved lines, a floor on what the compress trials move.
| requirement | quantity | corpus | at | observed | bound | distance | unit | status |
|---|---|---|---|---|---|---|---|---|
| leastArchive | archive bytes over the information the chosen model assigns | uorc-v0.3.0 | - | 575285 | 574444 | 841 | bytes | proved |
| wholeHost | longest chain of dependent decode steps over the total divided by the threads | uorc-v0.3.0 | 4 threads (met up to 1) | 198707536 | 49676884 | 149030652 | steps | proved |
| hostCeiling | decompressed bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) | uorc-v0.3.0 | host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) |
826314 | 11401593 | 10575279 | bytes/s | measured |
| hostCeiling | compressed input bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) | uorc-v0.3.0 | host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) |
75497 | 2153064 | 2077567 | bytes/s | measured |
| leastArchive | archive bytes over the information the chosen model assigns | canterbury | - | 350393 | 349228 | 1165 | bytes | proved |
| wholeHost | longest chain of dependent decode steps over the total divided by the threads | canterbury | 4 threads (met up to 1) | 474920872 | 118730218 | 356190654 | steps | proved |
| hostCeiling | decompressed bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) | canterbury | host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) |
827217 | 9190916 | 8363699 | bytes/s | measured |
| hostCeiling | compressed input bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) | canterbury | host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) |
103909 | 1995499 | 1891590 | bytes/s | measured |
| leastArchive | archive bytes over the information the chosen model assigns | silesia | - | 40900503 | 40896951 | 3552 | bytes | proved |
| wholeHost | longest chain of dependent decode steps over the total divided by the threads | silesia | 4 threads (met up to 1) | 35179213488 | 10016845692 | 25162367796 | steps | proved |
| hostCeiling | decompressed bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) | silesia | host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) |
800801 | 7790846 | 6990045 | bytes/s | measured |
| hostCeiling | compressed input bytes per second under the host's ceiling (Uorc.Host::ceilingNanos) | silesia | host ce7702cbee43 (AMD EPYC 9V74 80-Core Processor, 4 threads, avx2) |
143624 | 2218440 | 2074816 | bytes/s | measured |
Per family (first claim's corpus)
| family | members | archive bytes | decode steps |
|---|---|---|---|
| tiny | 2 | 1475 | 631296 |
| small | 2 | 2479 | 6441216 |
| text | 3 | 259504 | 162957848 |
| other | 1 | 311827 | 28677176 |
The register holds 42 claims over 3 corpora and 3 codec points; 10 concern other points (earlier releases, engine candidates) and are kept by κ, never rerun.
The model on the page
Performance rows: UC-PERF-01 (benchmark_target_unmet), UC-PERF-02 (kernel_theorem), UC-PERF-03 (kernel_theorem), UC-PERF-04 (kernel_theorem), UC-PERF-05 (kernel_theorem), UC-PERF-06 (kernel_theorem), UC-PERF-07 (kernel_theorem), UC-PERF-08 (kernel_theorem), UC-PERF-09 (kernel_theorem), UC-PERF-10 (kernel_theorem), UC-PERF-11 (build_evidence), UC-PERF-16 (build_evidence), UC-PERF-17 (build_evidence).
Claims: 42 recorded, 35 proved, 1 refuted (listed above).
Engine: tick 0, rule30 register 0x9e3779b97f4a7c15, 10 strategies in the portfolio, 70 weights.
The full register is model.json, on the Pages site and attached to this release.
uorc benchmarks
uorc 0.6.0, 0 search steps per file, linux/x64. Measurement only; no target is set.
Machine ceiling: 4 cores (Intel(R) Xeon(R) 6975P-C), 15.3 GiB memory; memory copy 14966 MB/s on one core and 18694 MB/s on all 4. A decoder cannot write its output faster than the machine copies memory, so the last column is decompress throughput as a share of the all-core copy rate. uorc uses every core (8 MiB frames in parallel); the other tools run with their default thread settings.
canterbury
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s | decompress / copy |
|---|---|---|---|---|---|---|
| uorc (0 steps) | 11 | 350393 | 8.022 | 0.12 | 0.64 | 0.0034% |
| gzip -9 | 11 | 730625 | 3.847 | 5.30 | 81.15 | 0.43% |
| bzip2 -9 | 11 | 542710 | 5.179 | 20.39 | 39.16 | 0.21% |
| xz -9e | 11 | 493080 | 5.700 | 1.84 | 57.50 | 0.31% |
| zstd -19 --long | 11 | 516216 | 5.445 | 1.92 | 86.40 | 0.46% |
| brotli -q 11 | 11 | 490662 | 5.729 | 0.73 | 83.33 | 0.45% |
| zpaq -m5 | 11 | 361718 | 7.771 | 0.61 | 0.60 | 0.0032% |
| 7z PPMd -mx9 | 11 | 575170 | 4.887 | 10.44 | 10.06 | 0.054% |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 | zpaq -m5 | 7z PPMd -mx9 |
|---|---|---|---|---|---|---|---|---|---|
| alice29.txt | 152089 | 37151 | 54179 | 43202 | 48528 | 49212 | 46487 | 37591 | 38956 |
| asyoulik.txt | 125179 | 34553 | 48816 | 39569 | 44592 | 45138 | 42712 | 35369 | 38434 |
| cp.html | 24603 | 6351 | 7973 | 7624 | 7652 | 7716 | 6894 | 7418 | 7507 |
| fields.c | 11150 | 2402 | 3127 | 3039 | 3032 | 3017 | 2717 | 3469 | 3110 |
| grammar.lsp | 3721 | 1064 | 1234 | 1283 | 1292 | 1214 | 1124 | 2069 | 1326 |
| kennedy.xls | 1029744 | 13895 | 209721 | 130280 | 51868 | 64826 | 61498 | 16813 | 182238 |
| lcet10.txt | 426754 | 89314 | 144418 | 107706 | 119488 | 121337 | 113416 | 90013 | 102503 |
| plrabn12.txt | 481861 | 127081 | 194264 | 145577 | 165456 | 167439 | 163267 | 127568 | 138560 |
| ptt5 | 513216 | 28280 | 52377 | 49759 | 39860 | 43610 | 40939 | 28561 | 48463 |
| sum | 38240 | 8943 | 12768 | 12909 | 9500 | 10978 | 10144 | 10324 | 12417 |
| xargs.1 | 4227 | 1359 | 1748 | 1762 | 1812 | 1729 | 1464 | 2523 | 1656 |
silesia
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s | decompress / copy |
|---|---|---|---|---|---|---|
| uorc (0 steps) | 12 | 40900503 | 5.182 | 0.16 | 0.88 | 0.0047% |
| gzip -9 | 12 | 67631918 | 3.134 | 12.74 | 171.52 | 0.92% |
| bzip2 -9 | 12 | 54506769 | 3.888 | 16.03 | 34.36 | 0.18% |
| xz -9e | 12 | 48456004 | 4.374 | 2.10 | 81.82 | 0.44% |
| zstd -19 --long | 12 | 52646619 | 4.026 | 2.97 | 463.93 | 2.5% |
| brotli -q 11 | 12 | 49564563 | 4.276 | 0.60 | 246.53 | 1.3% |
| zpaq -m5 | 12 | 39112562 | 5.419 | 0.57 | 0.56 | 0.0030% |
| 7z PPMd -mx9 | 12 | 47684624 | 4.445 | 7.82 | 7.24 | 0.039% |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9...
uorc v0.5.0
uorc v0.5.0
Client: https://uor-foundation.github.io/compression/
Closed claims
Codec point 3cd4e997c1460e85 (export 6b5653bf17c4f34e, plan portfolio, 1 lane). Sizes and decode steps are exact: each was decided by running this codec over the κ-named corpus and is recorded with its decision in the release's frontier.toml. A step is one model input evaluated for one coded bit.
| corpus | corpus κ | input bytes | archive bytes | decode steps | steps per byte | status | decided by |
|---|---|---|---|---|---|---|---|
| uorc-v0.3.0 | 9b781bfc9840 |
1442315 | 575439 | 198707536 | 137.77 | proved | factory |
| canterbury | c97b3c539721 |
2810784 | 351887 | 474920872 | 168.96 | proved | factory |
| silesia | 45094a500116 |
211938580 | 40987562 | 40067382768 | 189.05 | proved | factory |
UC-PERF-01 target
On every public corpus, the archive is no larger than each pinned comparator's. A refuted row is a comparator this codec does not yet reach.
| corpus | comparator | comparator bytes | uorc bytes | status |
|---|---|---|---|---|
| uorc-v0.3.0 | gzip -9 | 650271 | 575439 | proved |
| uorc-v0.3.0 | bzip2 -9 | 606478 | 575439 | proved |
| uorc-v0.3.0 | xz -9e | 595432 | 575439 | proved |
| canterbury | gzip -9 | 730625 | 351887 | proved |
| canterbury | bzip2 -9 | 542710 | 351887 | proved |
| canterbury | xz -9e | 493080 | 351887 | proved |
| canterbury | zstd -19 --long | 516216 | 351887 | proved |
| canterbury | brotli -q 11 | 490662 | 351887 | proved |
| canterbury | zpaq -m5 | 361718 | 351887 | proved |
| canterbury | 7z PPMd -mx9 | 575170 | 351887 | proved |
| silesia | gzip -9 | 67631918 | 40987562 | proved |
| silesia | bzip2 -9 | 54506769 | 40987562 | proved |
| silesia | xz -9e | 48456004 | 40987562 | proved |
| silesia | zstd -19 --long | 52646619 | 40987562 | proved |
| silesia | brotli -q 11 | 49564563 | 40987562 | proved |
| silesia | zpaq -m5 | 39112562 | 40987562 | refuted |
| silesia | 7z PPMd -mx9 | 47684624 | 40987562 | proved |
Per family (first claim's corpus)
| family | members | archive bytes | decode steps |
|---|---|---|---|
| tiny | 2 | 1475 | 631296 |
| small | 2 | 2487 | 6441216 |
| text | 3 | 259617 | 162957848 |
| other | 1 | 311860 | 28677176 |
The register holds 24 claims over 3 corpora and 2 codec points; 4 concern other points (earlier releases, engine candidates) and are kept by κ, never rerun.
The model on the page
Performance rows: UC-PERF-01 (benchmark_target_unmet), UC-PERF-02 (kernel_theorem), UC-PERF-03 (kernel_theorem), UC-PERF-04 (kernel_theorem), UC-PERF-05 (kernel_theorem), UC-PERF-06 (kernel_theorem), UC-PERF-07 (kernel_theorem), UC-PERF-08 (kernel_theorem), UC-PERF-09 (kernel_theorem), UC-PERF-10 (kernel_theorem), UC-PERF-11 (build_evidence), UC-PERF-16 (build_evidence), UC-PERF-17 (build_evidence).
Claims: 24 recorded, 23 proved, 1 refuted (listed above).
Engine: tick 0, rule30 register 0x9e3779b97f4a7c15, 10 strategies in the portfolio, 70 weights.
The full register is model.json, on the Pages site and attached to this release.
uorc benchmarks
uorc 0.5.0, 0 search steps per file, linux/x64. Measurement only; no target is set.
Machine ceiling: 4 cores (AMD EPYC 7763 64-Core Processor), 15.6 GiB memory; memory copy 20202 MB/s on one core and 22474 MB/s on all 4. A decoder cannot write its output faster than the machine copies memory, so the last column is decompress throughput as a share of the all-core copy rate. uorc uses every core (8 MiB frames in parallel); the other tools run with their default thread settings.
canterbury
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s | decompress / copy |
|---|---|---|---|---|---|---|
| uorc (0 steps) | 11 | 350645 | 8.016 | 0.07 | 0.39 | 0.0018% |
| gzip -9 | 11 | 730625 | 3.847 | 4.22 | 61.92 | 0.28% |
| bzip2 -9 | 11 | 542710 | 5.179 | 15.73 | 26.62 | 0.12% |
| xz -9e | 11 | 493080 | 5.700 | 1.67 | 39.79 | 0.18% |
| zstd -19 --long | 11 | 516216 | 5.445 | 1.37 | 57.55 | 0.26% |
| brotli -q 11 | 11 | 490662 | 5.729 | 0.56 | 58.66 | 0.26% |
| zpaq -m5 | 11 | 361718 | 7.771 | 0.38 | 0.38 | 0.0017% |
| 7z PPMd -mx9 | 11 | 575170 | 4.887 | 7.26 | 7.35 | 0.033% |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 | zpaq -m5 | 7z PPMd -mx9 |
|---|---|---|---|---|---|---|---|---|---|
| alice29.txt | 152089 | 37158 | 54179 | 43202 | 48528 | 49212 | 46487 | 37591 | 38956 |
| asyoulik.txt | 125179 | 34559 | 48816 | 39569 | 44592 | 45138 | 42712 | 35369 | 38434 |
| cp.html | 24603 | 6351 | 7973 | 7624 | 7652 | 7716 | 6894 | 7418 | 7507 |
| fields.c | 11150 | 2402 | 3127 | 3039 | 3032 | 3017 | 2717 | 3469 | 3110 |
| grammar.lsp | 3721 | 1064 | 1234 | 1283 | 1292 | 1214 | 1124 | 2069 | 1326 |
| kennedy.xls | 1029744 | 14093 | 209721 | 130280 | 51868 | 64826 | 61498 | 16813 | 182238 |
| lcet10.txt | 426754 | 89314 | 144418 | 107706 | 119488 | 121337 | 113416 | 90013 | 102503 |
| plrabn12.txt | 481861 | 127122 | 194264 | 145577 | 165456 | 167439 | 163267 | 127568 | 138560 |
| ptt5 | 513216 | 28280 | 52377 | 49759 | 39860 | 43610 | 40939 | 28561 | 48463 |
| sum | 38240 | 8943 | 12768 | 12909 | 9500 | 10978 | 10144 | 10324 | 12417 |
| xargs.1 | 4227 | 1359 | 1748 | 1762 | 1812 | 1729 | 1464 | 2523 | 1656 |
silesia
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s | decompress / copy |
|---|---|---|---|---|---|---|
| uorc (0 steps) | 12 | 40925775 | 5.179 | 0.10 | 0.62 | 0.0027% |
| gzip -9 | 12 | 67631918 | 3.134 | 10.77 | 145.02 | 0.65% |
| bzip2 -9 | 12 | 54506769 | 3.888 | 13.09 | 28.83 | 0.13% |
| xz -9e | 12 | 48456004 | 4.374 | 1.94 | 63.93 | 0.28% |
| zstd -19 --long | 12 | 52646619 | 4.026 | 2.24 | 321.88 | 1.4% |
| brotli -q 11 | 12 | 49564563 | 4.276 | 0.49 | 214.91 | 0.96% |
| zpaq -m5 | 12 | 39112562 | 5.419 | 0.40 | 0.40 | 0.0018% |
| 7z PPMd -mx9 | 12 | 47684624 | 4.445 | 6.49 | 6.05 | 0.027% |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 | zpaq -m5 | 7z PPMd -mx9 |
|---|---|---|---|---|---|---|---|---|---|
| dickens | 10192446 | 2240481 | 3851815 | 2799520 | 2831212 | 2849320 | 2827777 | 2094743 | 2280117 |
| mozilla | 51220480 | 12587898 | 18994134 | 17914392 | 13376240 | 14978836 | 13872265 | 12041055 | 15911894 |
| mr | 9970564 | 2158855 | 3673937 | 2441280 | 2751892 | 3105810 | 2823136 | 2181310 | 2320767 |
| nci | 33553445 | 1387073 | 2987529 | 1812734 | 1449272 | 1615898 | 1519768 | 1251108 | 1484569 |
| ooffice | 6152192 | 1794476 | 3090434 | 2862526 | 2427224 | 2595308 | 2478855 | 1766550 | 2496131 |
| osdb | 10085684 | 2225316 | 3716337 | 2802792 | 2844556 | 3099934 | 2816278 | 2204741 | 2384175 |
| reymont | 6627202 | 1007520 | 1820826 | 1246230 | 1315592 | 1348541 | 1332158 | 956499 | 1054291 |
| samba | 21606400 | 3169580 | 5408266 | 4549759 | 3739524 | 3876656 | 3766340 | 3053820 | 3815315 |
| sao | 7251944 | 3979521 | 5327037 | 4940524 | 4425664 | 5000573 | 4586092 | 3899258 | 4783825 |
| webster | 41458703 | 6392659 | 12061616 | 8644714 | 8368672 | 8592754 | 8428575 | 5666831 | 6942883 |
| x-ray | 8474240 | 3653386 | 6037707 | 4051112 | 4491264 | 5129825 | 4682753 | 3669701 | 3850893 |
| xml | 5345280 | 329010 | 662280 | 441186 | 434892 | 453164 | 430566 | 326946 | 359764 |
Ratio is input bytes over archive bytes, and throughput is input MB per second, both over the files that compressor round-tripped. ✗ marks a failed round trip. zpaq and 7z archive bytes include their container headers. Tool versions:
- gzip -9: gzip 1.12
- bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
- xz -9e: xz (XZ Utils) 5.4.5
- zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
- brotli -q 11: brotli 1.1.0
- zpaq -m5: zpaq v7.15 journaling archiver, compiled Jan 5 2021
- 7z PPMd -mx9: 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20
Benchmark corpora
Benchmark corpora pinned by frontier.toml (sha256 per member), mirrored by scripts/corpora.mjs so a corpus host refusing a runner cannot fail a release. Not a uorc release.
uorc v0.4.0
uorc v0.4.0
Client: https://uor-foundation.github.io/compression/
uorc benchmarks
uorc 0.4.0, 0 search steps per file, linux/x64. Measurement only; no target is set.
Machine ceiling: 4 cores (AMD EPYC 9V74 80-Core Processor), 15.6 GiB memory; memory copy 16366 MB/s on one core and 26526 MB/s on all 4. A decoder cannot write its output faster than the machine copies memory, so the last column is decompress throughput as a share of the all-core copy rate. uorc uses every core (8 MiB frames in parallel); the other tools run with their default thread settings.
canterbury
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s | decompress / copy |
|---|---|---|---|---|---|---|
| uorc (0 steps) | 11 | 352806 | 7.967 | 0.30 | 0.65 | 0.0025% |
| gzip -9 | 11 | 730625 | 3.847 | 4.93 | 70.66 | 0.27% |
| bzip2 -9 | 11 | 542710 | 5.179 | 19.21 | 33.23 | 0.13% |
| xz -9e | 11 | 493080 | 5.700 | 1.89 | 49.03 | 0.18% |
| zstd -19 --long | 11 | 516216 | 5.445 | 1.68 | 62.90 | 0.24% |
| brotli -q 11 | 11 | 490662 | 5.729 | 0.71 | 68.89 | 0.26% |
| zpaq -m5 | 11 | 361718 | 7.771 | 0.50 | 0.49 | 0.0019% |
| 7z PPMd -mx9 | 11 | 575170 | 4.887 | 8.33 | 8.25 | 0.031% |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 | zpaq -m5 | 7z PPMd -mx9 |
|---|---|---|---|---|---|---|---|---|---|
| alice29.txt | 152089 | 37189 | 54179 | 43202 | 48528 | 49212 | 46487 | 37591 | 38956 |
| asyoulik.txt | 125179 | 34665 | 48816 | 39569 | 44592 | 45138 | 42712 | 35369 | 38434 |
| cp.html | 24603 | 6485 | 7973 | 7624 | 7652 | 7716 | 6894 | 7418 | 7507 |
| fields.c | 11150 | 2529 | 3127 | 3039 | 3032 | 3017 | 2717 | 3469 | 3110 |
| grammar.lsp | 3721 | 1098 | 1234 | 1283 | 1292 | 1214 | 1124 | 2069 | 1326 |
| kennedy.xls | 1029744 | 14179 | 209721 | 130280 | 51868 | 64826 | 61498 | 16813 | 182238 |
| lcet10.txt | 426754 | 90134 | 144418 | 107706 | 119488 | 121337 | 113416 | 90013 | 102503 |
| plrabn12.txt | 481861 | 127695 | 194264 | 145577 | 165456 | 167439 | 163267 | 127568 | 138560 |
| ptt5 | 513216 | 28342 | 52377 | 49759 | 39860 | 43610 | 40939 | 28561 | 48463 |
| sum | 38240 | 8944 | 12768 | 12909 | 9500 | 10978 | 10144 | 10324 | 12417 |
| xargs.1 | 4227 | 1546 | 1748 | 1762 | 1812 | 1729 | 1464 | 2523 | 1656 |
silesia
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s | decompress / copy |
|---|---|---|---|---|---|---|
| uorc (0 steps) | 12 | 41003375 | 5.169 | 0.49 | 0.75 | 0.0028% |
| gzip -9 | 12 | 67631918 | 3.134 | 11.88 | 168.58 | 0.64% |
| bzip2 -9 | 12 | 54506769 | 3.888 | 15.98 | 35.08 | 0.13% |
| xz -9e | 12 | 48456004 | 4.374 | 2.06 | 77.98 | 0.29% |
| zstd -19 --long | 12 | 52646619 | 4.026 | 2.64 | 388.61 | 1.5% |
| brotli -q 11 | 12 | 49564563 | 4.276 | 0.60 | 244.70 | 0.92% |
| zpaq -m5 | 12 | 39112562 | 5.419 | 0.50 | 0.50 | 0.0019% |
| 7z PPMd -mx9 | 12 | 47684624 | 4.445 | 6.75 | 6.37 | 0.024% |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 | zpaq -m5 | 7z PPMd -mx9 |
|---|---|---|---|---|---|---|---|---|---|
| dickens | 10192446 | 2242072 | 3851815 | 2799520 | 2831212 | 2849320 | 2827777 | 2094743 | 2280117 |
| mozilla | 51220480 | 12611789 | 18994134 | 17914392 | 13376240 | 14978836 | 13872265 | 12041055 | 15911894 |
| mr | 9970564 | 2161741 | 3673937 | 2441280 | 2751892 | 3105810 | 2823136 | 2181310 | 2320767 |
| nci | 33553445 | 1389780 | 2987529 | 1812734 | 1449272 | 1615898 | 1519768 | 1251108 | 1484569 |
| ooffice | 6152192 | 1800251 | 3090434 | 2862526 | 2427224 | 2595308 | 2478855 | 1766550 | 2496131 |
| osdb | 10085684 | 2227043 | 3716337 | 2802792 | 2844556 | 3099934 | 2816278 | 2204741 | 2384175 |
| reymont | 6627202 | 1007649 | 1820826 | 1246230 | 1315592 | 1348541 | 1332158 | 956499 | 1054291 |
| samba | 21606400 | 3183192 | 5408266 | 4549759 | 3739524 | 3876656 | 3766340 | 3053820 | 3815315 |
| sao | 7251944 | 3980702 | 5327037 | 4940524 | 4425664 | 5000573 | 4586092 | 3899258 | 4783825 |
| webster | 41458703 | 6411381 | 12061616 | 8644714 | 8368672 | 8592754 | 8428575 | 5666831 | 6942883 |
| x-ray | 8474240 | 3656010 | 6037707 | 4051112 | 4491264 | 5129825 | 4682753 | 3669701 | 3850893 |
| xml | 5345280 | 331765 | 662280 | 441186 | 434892 | 453164 | 430566 | 326946 | 359764 |
Ratio is input bytes over archive bytes, and throughput is input MB per second, both over the files that compressor round-tripped. ✗ marks a failed round trip. zpaq and 7z archive bytes include their container headers. Tool versions:
- gzip -9: gzip 1.12
- bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
- xz -9e: xz (XZ Utils) 5.4.5
- zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
- brotli -q 11: brotli 1.1.0
- zpaq -m5: zpaq v7.15 journaling archiver, compiled Jan 5 2021
- 7z PPMd -mx9: 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20
uorc v0.3.0
uorc v0.3.0
Client: https://uor-foundation.github.io/compression/
uorc benchmarks
uorc 0.3.0, 0 search steps per file, linux/x64. Measurement only; no target is set.
Machine ceiling: 4 cores (AMD EPYC 9V45 96-Core Processor), 15.6 GiB memory; memory copy 22804 MB/s on one core and 28241 MB/s on all 4. A decoder cannot write its output faster than the machine copies memory, so the last column is decompress throughput as a share of the all-core copy rate. uorc uses every core (8 MiB frames in parallel); the other tools run with their default thread settings.
canterbury
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s | decompress / copy |
|---|---|---|---|---|---|---|
| uorc (0 steps) | 11 | 355559 | 7.905 | 0.71 | 0.63 | 0.0022% |
| gzip -9 | 11 | 730625 | 3.847 | 5.99 | 66.93 | 0.24% |
| bzip2 -9 | 11 | 542710 | 5.179 | 20.77 | 35.36 | 0.13% |
| xz -9e | 11 | 493080 | 5.700 | 2.07 | 49.31 | 0.17% |
| zstd -19 --long | 11 | 516216 | 5.445 | 1.89 | 69.32 | 0.25% |
| brotli -q 11 | 11 | 490662 | 5.729 | 0.82 | 68.20 | 0.24% |
| zpaq -m5 | 11 | 361718 | 7.771 | 0.54 | 0.56 | 0.0020% |
| 7z PPMd -mx9 | 11 | 575170 | 4.887 | 8.53 | 9.18 | 0.033% |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 | zpaq -m5 | 7z PPMd -mx9 |
|---|---|---|---|---|---|---|---|---|---|
| alice29.txt | 152089 | 37321 | 54179 | 43202 | 48528 | 49212 | 46487 | 37591 | 38956 |
| asyoulik.txt | 125179 | 34701 | 48816 | 39569 | 44592 | 45138 | 42712 | 35369 | 38434 |
| cp.html | 24603 | 6485 | 7973 | 7624 | 7652 | 7716 | 6894 | 7418 | 7507 |
| fields.c | 11150 | 2531 | 3127 | 3039 | 3032 | 3017 | 2717 | 3469 | 3110 |
| grammar.lsp | 3721 | 1098 | 1234 | 1283 | 1292 | 1214 | 1124 | 2069 | 1326 |
| kennedy.xls | 1029744 | 14838 | 209721 | 130280 | 51868 | 64826 | 61498 | 16813 | 182238 |
| lcet10.txt | 426754 | 90869 | 144418 | 107706 | 119488 | 121337 | 113416 | 90013 | 102503 |
| plrabn12.txt | 481861 | 128152 | 194264 | 145577 | 165456 | 167439 | 163267 | 127568 | 138560 |
| ptt5 | 513216 | 28972 | 52377 | 49759 | 39860 | 43610 | 40939 | 28561 | 48463 |
| sum | 38240 | 9046 | 12768 | 12909 | 9500 | 10978 | 10144 | 10324 | 12417 |
| xargs.1 | 4227 | 1546 | 1748 | 1762 | 1812 | 1729 | 1464 | 2523 | 1656 |
silesia
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s | decompress / copy |
|---|---|---|---|---|---|---|
| uorc (0 steps) | 12 | 41726363 | 5.079 | 1.21 | 0.87 | 0.0031% |
| gzip -9 | 12 | 67631918 | 3.134 | 14.54 | 186.90 | 0.66% |
| bzip2 -9 | 12 | 54506769 | 3.888 | 17.78 | 41.28 | 0.15% |
| xz -9e | 12 | 48456004 | 4.374 | 2.15 | 81.58 | 0.29% |
| zstd -19 --long | 12 | 52646619 | 4.026 | 2.75 | 437.72 | 1.5% |
| brotli -q 11 | 12 | 49564563 | 4.276 | 0.69 | 261.69 | 0.93% |
| zpaq -m5 | 12 | 39112562 | 5.419 | 0.57 | 0.55 | 0.0020% |
| 7z PPMd -mx9 | 12 | 47684624 | 4.445 | 6.74 | 6.32 | 0.022% |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 | zpaq -m5 | 7z PPMd -mx9 |
|---|---|---|---|---|---|---|---|---|---|
| dickens | 10192446 | 2254587 | 3851815 | 2799520 | 2831212 | 2849320 | 2827777 | 2094743 | 2280117 |
| mozilla | 51220480 | 12869415 | 18994134 | 17914392 | 13376240 | 14978836 | 13872265 | 12041055 | 15911894 |
| mr | 9970564 | 2186070 | 3673937 | 2441280 | 2751892 | 3105810 | 2823136 | 2181310 | 2320767 |
| nci | 33553445 | 1448680 | 2987529 | 1812734 | 1449272 | 1615898 | 1519768 | 1251108 | 1484569 |
| ooffice | 6152192 | 1839225 | 3090434 | 2862526 | 2427224 | 2595308 | 2478855 | 1766550 | 2496131 |
| osdb | 10085684 | 2283845 | 3716337 | 2802792 | 2844556 | 3099934 | 2816278 | 2204741 | 2384175 |
| reymont | 6627202 | 1026475 | 1820826 | 1246230 | 1315592 | 1348541 | 1332158 | 956499 | 1054291 |
| samba | 21606400 | 3276175 | 5408266 | 4549759 | 3739524 | 3876656 | 3766340 | 3053820 | 3815315 |
| sao | 7251944 | 3996589 | 5327037 | 4940524 | 4425664 | 5000573 | 4586092 | 3899258 | 4783825 |
| webster | 41458703 | 6500821 | 12061616 | 8644714 | 8368672 | 8592754 | 8428575 | 5666831 | 6942883 |
| x-ray | 8474240 | 3706874 | 6037707 | 4051112 | 4491264 | 5129825 | 4682753 | 3669701 | 3850893 |
| xml | 5345280 | 337607 | 662280 | 441186 | 434892 | 453164 | 430566 | 326946 | 359764 |
Ratio is input bytes over archive bytes, and throughput is input MB per second, both over the files that compressor round-tripped. ✗ marks a failed round trip. zpaq and 7z archive bytes include their container headers. Tool versions:
- gzip -9: gzip 1.12
- bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
- xz -9e: xz (XZ Utils) 5.4.5
- zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
- brotli -q 11: brotli 1.1.0
- zpaq -m5: zpaq v7.15 journaling archiver, compiled Jan 5 2021
- 7z PPMd -mx9: 7-Zip 23.01 (x64) : Copyright (c) 1999-2023 Igor Pavlov : 2023-06-20
uorc v0.2.0
uorc v0.2.0
Client: https://uor-foundation.github.io/compression/
uorc benchmarks
uorc 0.1.0, 0 search steps per file, linux/x64. Measurement only; no target is set.
canterbury
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s |
|---|---|---|---|---|---|
| uorc (0 steps) | 11 | 551058 | 5.101 | 16.49 | 51.78 |
| uorc --best (0 steps) | 11 | 355559 | 7.905 | 0.35 | 0.73 |
| gzip -9 | 11 | 730625 | 3.847 | 6.37 | 100.39 |
| bzip2 -9 | 11 | 542710 | 5.179 | 23.47 | 41.01 |
| xz -9e | 11 | 493080 | 5.700 | 2.62 | 65.64 |
| zstd -19 --long | 11 | 516216 | 5.445 | 2.18 | 88.17 |
| brotli -q 11 | 11 | 490662 | 5.729 | 0.93 | 99.03 |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | uorc --best (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 |
|---|---|---|---|---|---|---|---|---|
| alice29.txt | 152089 | 52002 | 37321 | 54179 | 43202 | 48528 | 49212 | 46487 |
| asyoulik.txt | 125179 | 47311 | 34701 | 48816 | 39569 | 44592 | 45138 | 42712 |
| cp.html | 24603 | 7968 | 6485 | 7973 | 7624 | 7652 | 7716 | 6894 |
| fields.c | 11150 | 3152 | 2531 | 3127 | 3039 | 3032 | 3017 | 2717 |
| grammar.lsp | 3721 | 1347 | 1098 | 1234 | 1283 | 1292 | 1214 | 1124 |
| kennedy.xls | 1029744 | 61507 | 14838 | 209721 | 130280 | 51868 | 64826 | 61498 |
| lcet10.txt | 426754 | 130788 | 90869 | 144418 | 107706 | 119488 | 121337 | 113416 |
| plrabn12.txt | 481861 | 180903 | 128152 | 194264 | 145577 | 165456 | 167439 | 163267 |
| ptt5 | 513216 | 53254 | 28972 | 52377 | 49759 | 39860 | 43610 | 40939 |
| sum | 38240 | 10954 | 9046 | 12768 | 12909 | 9500 | 10978 | 10144 |
| xargs.1 | 4227 | 1872 | 1546 | 1748 | 1762 | 1812 | 1729 | 1464 |
silesia
| compressor | files | archive bytes | ratio | compress MB/s | decompress MB/s |
|---|---|---|---|---|---|
| uorc (0 steps) | 12 | 57167560 | 3.707 | 11.03 | 56.58 |
| uorc --best (0 steps) | 12 | 42331696 | 5.007 | 0.54 | 0.74 |
| gzip -9 | 12 | 67631918 | 3.134 | 15.66 | 203.05 |
| bzip2 -9 | 12 | 54506769 | 3.888 | 19.45 | 44.42 |
| xz -9e | 12 | 48456004 | 4.374 | 2.81 | 91.35 |
| zstd -19 --long | 12 | 52646619 | 4.026 | 3.74 | 512.44 |
| brotli -q 11 | 12 | 49564563 | 4.276 | 0.79 | 316.96 |
Per file (archive bytes)
| file | bytes | uorc (0 steps) | uorc --best (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 |
|---|---|---|---|---|---|---|---|---|
| dickens | 10192446 | 3375931 | 2266775 | 3851815 | 2799520 | 2831212 | 2849320 | 2827777 |
| mozilla | 51220480 | 15493734 | 12972784 | 18994134 | 17914392 | 13376240 | 14978836 | 13872265 |
| mr | 9970564 | 3129345 | 2189830 | 3673937 | 2441280 | 2751892 | 3105810 | 2823136 |
| nci | 33553445 | 2249012 | 1471159 | 2987529 | 1812734 | 1449272 | 1615898 | 1519768 |
| ooffice | 6152192 | 2699360 | 2130028 | 3090434 | 2862526 | 2427224 | 2595308 | 2478855 |
| osdb | 10085684 | 3356987 | 2290527 | 3716337 | 2802792 | 2844556 | 3099934 | 2816278 |
| reymont | 6627202 | 1696532 | 1026475 | 1820826 | 1246230 | 1315592 | 1348541 | 1332158 |
| samba | 21606400 | 4298090 | 3333282 | 5408266 | 4549759 | 3739524 | 3876656 | 3766340 |
| sao | 7251944 | 4933351 | 3996589 | 5327037 | 4940524 | 4425664 | 5000573 | 4586092 |
| webster | 41458703 | 10327487 | 6609767 | 12061616 | 8644714 | 8368672 | 8592754 | 8428575 |
| x-ray | 8474240 | 5077000 | 3706873 | 6037707 | 4051112 | 4491264 | 5129825 | 4682753 |
| xml | 5345280 | 530731 | 337607 | 662280 | 441186 | 434892 | 453164 | 430566 |
Ratio is input bytes over archive bytes, and throughput is input MB per second, both over the files that compressor round-tripped. ✗ marks a failed round trip. Tool versions:
- gzip -9: gzip 1.12
- bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
- xz -9e: xz (XZ Utils) 5.4.5
- zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
- brotli -q 11: brotli 1.1.0
uorc v0.1.0
uorc v0.1.0
Client: https://uor-foundation.github.io/compression/
uorc benchmark: canterbury
uorc 0.1.0, 0 search steps per file, linux/x64. Measurement only; no target is set.
| file | bytes | uorc (0 steps) | gzip -9 | bzip2 -9 | xz -9e | zstd -19 --long | brotli -q 11 |
|---|---|---|---|---|---|---|---|
| alice29.txt | 152089 | 55563 | 54179 | 43202 | 48528 | 49212 | 46487 |
| asyoulik.txt | 125179 | 50593 | 48816 | 39569 | 44592 | 45138 | 42712 |
| cp.html | 24603 | 10517 | 7973 | 7624 | 7652 | 7716 | 6894 |
| fields.c | 11150 | 5711 | 3127 | 3039 | 3032 | 3017 | 2717 |
| grammar.lsp | 3721 | 3766 | 1234 | 1283 | 1292 | 1214 | 1124 |
| kennedy.xls | 1029744 | 64536 | 209721 | 130280 | 51868 | 64826 | 61498 |
| lcet10.txt | 426754 | 137548 | 144418 | 107706 | 119488 | 121337 | 113416 |
| plrabn12.txt | 481861 | 190125 | 194264 | 145577 | 165456 | 167439 | 163267 |
| ptt5 | 513216 | 56083 | 52377 | 49759 | 39860 | 43610 | 40939 |
| sum | 38240 | 13620 | 12768 | 12909 | 9500 | 10978 | 10144 |
| xargs.1 | 4227 | 4272 | 1748 | 1762 | 1812 | 1729 | 1464 |
| total | 2810784 | 592334 | 730625 | 542710 | 493080 | 516216 | 490662 |
Archive sizes in bytes; ✗ marks a failed round trip. Tool versions:
- gzip -9: gzip 1.12
- bzip2 -9: bzip2, a block-sorting file compressor. Version 1.0.8, 13-Jul-2019.
- xz -9e: xz (XZ Utils) 5.4.5
- zstd -19 --long: *** Zstandard CLI (64-bit) v1.5.7, by Yann Collet ***
- brotli -q 11: brotli 1.1.0