Skip to content

Commit 586965a

Browse files
RaduBerindeRaduBerinde
committed
compressionanalyzer: don't analyze Zstd levels 5 and 7
From experiments so far, these levels are too slow (and with marginal size benefit) so we will not be looking at using them, at least for now. Remove them from the compression analyzer (which should speed it up significantly). For example (data from a TPCC backup): ``` Snappy ZSTD1 ZSTD3 ZSTD5 ZSTD7 CR 2.23 ± 6% 2.72 ± 10% 2.85 ± 9% 2.95 ± 9% 3.05 ± 10% Comp 734MBps ± 27% 76MBps ± 25% 61MBps ± 26% 20MBps ± 16% 14MBps ± 16% Decomp 1877MBps ± 30% 228MBps ± 27% 222MBps ± 23% 225MBps ± 22% 220MBps ± 19% ```
1 parent a2d5e41 commit 586965a

File tree

4 files changed

+64
-54
lines changed

4 files changed

+64
-54
lines changed

‎sstable/compressionanalyzer/block_analyzer.go‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,7 @@ func (a *BlockAnalyzer) runExperiment(
8989
}
9090
decompressionTime := t2.Elapsed()
9191

92-
// CPU times are in nanoseconds / byte.
92+
// CPU times are in nanoseconds per uncompressed byte.
9393
pa.CompressionTime.Add(float64(compressionTime)/float64(len(block)), uint64(len(block)))
9494
pa.DecompressionTime.Add(float64(decompressionTime)/float64(len(block)), uint64(len(block)))
9595
pa.CompressionRatio.Add(float64(len(block))/float64(len(compressed)), uint64(len(block)))

‎sstable/compressionanalyzer/buckets.go‎

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -101,11 +101,13 @@ var Settings = [...]compression.Setting{
101101
compression.MinLZBalanced,
102102
compression.ZstdLevel1,
103103
compression.ZstdLevel3,
104-
compression.ZstdLevel5,
105-
compression.ZstdLevel7,
104+
// Zstd levels 5+ are too slow (on the order of 15-20MB/s to compress) and
105+
// don't usually offer a very large benefit in terms of size vs. level 3.
106+
// compression.ZstdLevel5,
107+
// compression.ZstdLevel7,
106108
}
107109

108-
const numSettings = 7
110+
const numSettings = len(Settings)
109111

110112
// Buckets holds the results of all experiments.
111113
type Buckets [blockkind.NumKinds][numBlockSizes][numCompressibility]Bucket
@@ -121,7 +123,7 @@ type Bucket struct {
121123
// specific compression.Setting.
122124
type PerSetting struct {
123125
CompressionRatio WeightedWelford
124-
// CPU times are in nanoseconds per byte.
126+
// CPU times are in nanoseconds per uncompressed byte.
125127
CompressionTime WeightedWelford
126128
DecompressionTime WeightedWelford
127129
}

‎sstable/compressionanalyzer/testdata/buckets‎

Lines changed: 47 additions & 39 deletions
Original file line numberDiff line numberDiff line change
@@ -53,48 +53,56 @@ compressibility
5353

5454
example-buckets-string
5555
----
56-
Kind Size Range Test CR Samples Size Snappy MinLZ1 MinLZ2 ZSTD1 ZSTD3 ZSTD5 ZSTD7
57-
sstval 24-48KB 1.1-1.5 5 44.7KB ± 53% CR 1.34 ± 17% 2.57 ± 9% 3.64 ± 6% 4.29 ± 3% 5.48 ± 5% 6.21 ± 4% 7.15 ± 1%
58-
Comp 91MBps ± 3% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 0% 16MBps ± 0% 14MBps ± 0%
59-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
60-
sstval 24-48KB >2.5 6 34.3KB ± 71% CR 1.34 ± 22% 2.48 ± 6% 3.35 ± 8% 4.38 ± 6% 5.34 ± 3% 6.58 ± 4% 7.41 ± 4%
61-
Comp 92MBps ± 2% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 0% 16MBps ± 0% 14MBps ± 0%
62-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
63-
blobval 24-48KB 1.5-2.5 5 24.6KB ± 77% CR 1.65 ± 10% 2.53 ± 13% 3.56 ± 4% 4.45 ± 6% 5.40 ± 6% 6.37 ± 3% 7.36 ± 4%
64-
Comp 93MBps ± 2% 47MBps ± 1% 31MBps ± 1% 23MBps ± 1% 19MBps ± 1% 16MBps ± 0% 14MBps ± 0%
65-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
66-
filter >128KB <1.1 22 34.4KB ± 59% CR 1.49 ± 22% 2.34 ± 11% 3.31 ± 7% 4.46 ± 6% 5.52 ± 6% 6.37 ± 4% 7.50 ± 4%
67-
Comp 91MBps ± 3% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 1% 16MBps ± 0% 14MBps ± 0%
68-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
69-
rangedel 48-128KB >2.5 12 36.6KB ± 49% CR 1.34 ± 23% 2.64 ± 11% 3.56 ± 7% 4.26 ± 5% 5.52 ± 5% 6.35 ± 4% 7.45 ± 4%
70-
Comp 92MBps ± 3% 47MBps ± 2% 31MBps ± 1% 23MBps ± 1% 19MBps ± 1% 16MBps ± 0% 14MBps ± 0%
71-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
72-
rangekey >128KB >2.5 1 48.0KB ± 0% CR 1.90 ± 0% 2.40 ± 0% 3.50 ± 0% 4.80 ± 0% 5.30 ± 0% 6.20 ± 0% 7.10 ± 0%
73-
Comp 87MBps ± 0% 47MBps ± 0% 31MBps ± 0% 24MBps ± 0% 19MBps ± 0% 16MBps ± 0% 14MBps ± 0%
74-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
56+
Kind Size Range Test CR Samples Size Snappy MinLZ1 MinLZ2 ZSTD1 ZSTD3
57+
index <24KB 1.1-1.5 2 46.4KB ± 24% CR 1.34 ± 30% 2.56 ± 2% 3.79 ± 3% 4.21 ± 5% 5.75 ± 4%
58+
Comp 90MBps ± 3% 47MBps ± 2% 31MBps ± 0% 24MBps ± 1% 19MBps ± 0%
59+
Decomp 10MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
60+
index <24KB 1.5-2.5 5 53.8KB ± 24% CR 1.55 ± 18% 2.38 ± 11% 3.55 ± 10% 4.34 ± 6% 5.60 ± 6%
61+
Comp 92MBps ± 3% 46MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 0%
62+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
63+
index 48-128KB 1.1-1.5 7 36.2KB ± 71% CR 1.34 ± 19% 2.38 ± 11% 3.48 ± 7% 4.56 ± 5% 5.48 ± 5%
64+
Comp 93MBps ± 2% 46MBps ± 1% 31MBps ± 1% 24MBps ± 0% 19MBps ± 1%
65+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
66+
index >128KB 1.5-2.5 8 44.9KB ± 39% CR 1.28 ± 21% 2.28 ± 14% 3.30 ± 5% 4.40 ± 7% 5.50 ± 4%
67+
Comp 92MBps ± 3% 46MBps ± 2% 31MBps ± 1% 23MBps ± 0% 19MBps ± 1%
68+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
69+
sstval 24-48KB >2.5 10 43.2KB ± 43% CR 1.55 ± 15% 2.55 ± 8% 3.50 ± 8% 4.33 ± 6% 5.52 ± 4%
70+
Comp 90MBps ± 2% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 1%
71+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
72+
blobval <24KB 1.5-2.5 27 32.5KB ± 59% CR 1.39 ± 21% 2.53 ± 12% 3.47 ± 8% 4.41 ± 7% 5.44 ± 5%
73+
Comp 91MBps ± 3% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 1%
74+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
75+
>128KB 1.5-2.5 10 21.0KB ± 83% CR 1.34 ± 22% 2.41 ± 13% 3.55 ± 7% 4.35 ± 6% 5.37 ± 5%
76+
Comp 90MBps ± 3% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 1%
77+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
7578

7679
example-buckets-string min-samples=5
7780
----
78-
Kind Size Range Test CR Samples Size Snappy MinLZ1 MinLZ2 ZSTD1 ZSTD3 ZSTD5 ZSTD7
79-
sstval 24-48KB 1.1-1.5 5 44.7KB ± 53% CR 1.34 ± 17% 2.57 ± 9% 3.64 ± 6% 4.29 ± 3% 5.48 ± 5% 6.21 ± 4% 7.15 ± 1%
80-
Comp 91MBps ± 3% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 0% 16MBps ± 0% 14MBps ± 0%
81-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
82-
sstval 24-48KB >2.5 6 34.3KB ± 71% CR 1.34 ± 22% 2.48 ± 6% 3.35 ± 8% 4.38 ± 6% 5.34 ± 3% 6.58 ± 4% 7.41 ± 4%
83-
Comp 92MBps ± 2% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 0% 16MBps ± 0% 14MBps ± 0%
84-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
85-
blobval 24-48KB 1.5-2.5 5 24.6KB ± 77% CR 1.65 ± 10% 2.53 ± 13% 3.56 ± 4% 4.45 ± 6% 5.40 ± 6% 6.37 ± 3% 7.36 ± 4%
86-
Comp 93MBps ± 2% 47MBps ± 1% 31MBps ± 1% 23MBps ± 1% 19MBps ± 1% 16MBps ± 0% 14MBps ± 0%
87-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
88-
filter >128KB <1.1 22 34.4KB ± 59% CR 1.49 ± 22% 2.34 ± 11% 3.31 ± 7% 4.46 ± 6% 5.52 ± 6% 6.37 ± 4% 7.50 ± 4%
89-
Comp 91MBps ± 3% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 1% 16MBps ± 0% 14MBps ± 0%
90-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
91-
rangedel 48-128KB >2.5 12 36.6KB ± 49% CR 1.34 ± 23% 2.64 ± 11% 3.56 ± 7% 4.26 ± 5% 5.52 ± 5% 6.35 ± 4% 7.45 ± 4%
92-
Comp 92MBps ± 3% 47MBps ± 2% 31MBps ± 1% 23MBps ± 1% 19MBps ± 1% 16MBps ± 0% 14MBps ± 0%
93-
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0% 2MBps ± 0% 1MBps ± 0%
81+
Kind Size Range Test CR Samples Size Snappy MinLZ1 MinLZ2 ZSTD1 ZSTD3
82+
index <24KB 1.5-2.5 5 53.8KB ± 24% CR 1.55 ± 18% 2.38 ± 11% 3.55 ± 10% 4.34 ± 6% 5.60 ± 6%
83+
Comp 92MBps ± 3% 46MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 0%
84+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
85+
index 48-128KB 1.1-1.5 7 36.2KB ± 71% CR 1.34 ± 19% 2.38 ± 11% 3.48 ± 7% 4.56 ± 5% 5.48 ± 5%
86+
Comp 93MBps ± 2% 46MBps ± 1% 31MBps ± 1% 24MBps ± 0% 19MBps ± 1%
87+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
88+
index >128KB 1.5-2.5 8 44.9KB ± 39% CR 1.28 ± 21% 2.28 ± 14% 3.30 ± 5% 4.40 ± 7% 5.50 ± 4%
89+
Comp 92MBps ± 3% 46MBps ± 2% 31MBps ± 1% 23MBps ± 0% 19MBps ± 1%
90+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
91+
sstval 24-48KB >2.5 10 43.2KB ± 43% CR 1.55 ± 15% 2.55 ± 8% 3.50 ± 8% 4.33 ± 6% 5.52 ± 4%
92+
Comp 90MBps ± 2% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 1%
93+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
94+
blobval <24KB 1.5-2.5 27 32.5KB ± 59% CR 1.39 ± 21% 2.53 ± 12% 3.47 ± 8% 4.41 ± 7% 5.44 ± 5%
95+
Comp 91MBps ± 3% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 1%
96+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
97+
>128KB 1.5-2.5 10 21.0KB ± 83% CR 1.34 ± 22% 2.41 ± 13% 3.55 ± 7% 4.35 ± 6% 5.37 ± 5%
98+
Comp 90MBps ± 3% 47MBps ± 1% 31MBps ± 1% 24MBps ± 1% 19MBps ± 1%
99+
Decomp 9MBps ± 0% 5MBps ± 0% 3MBps ± 0% 2MBps ± 0% 2MBps ± 0%
94100

95101
example-buckets-csv min-samples=6
96102
----
97-
Kind,Size Range,Test CR,Samples,Size,Size±,Snappy CR,Snappy CR±,Snappy Comp ns/b,Snappy Comp±,Snappy Decomp ns/b,Snappy Decomp±,MinLZ1 CR,MinLZ1 CR±,MinLZ1 Comp ns/b,MinLZ1 Comp±,MinLZ1 Decomp ns/b,MinLZ1 Decomp±,MinLZ2 CR,MinLZ2 CR±,MinLZ2 Comp ns/b,MinLZ2 Comp±,MinLZ2 Decomp ns/b,MinLZ2 Decomp±,ZSTD1 CR,ZSTD1 CR±,ZSTD1 Comp ns/b,ZSTD1 Comp±,ZSTD1 Decomp ns/b,ZSTD1 Decomp±,ZSTD3 CR,ZSTD3 CR±,ZSTD3 Comp ns/b,ZSTD3 Comp±,ZSTD3 Decomp ns/b,ZSTD3 Decomp±,ZSTD5 CR,ZSTD5 CR±,ZSTD5 Comp ns/b,ZSTD5 Comp±,ZSTD5 Decomp ns/b,ZSTD5 Decomp±,ZSTD7 CR,ZSTD7 CR±,ZSTD7 Comp ns/b,ZSTD7 Comp±,ZSTD7 Decomp ns/b,ZSTD7 Decomp±
98-
sstval,24-48KB,>2.5,6,35074,24930,1.337,0.289,10.348,0.191,100.419,0.268,2.483,0.157,20.422,0.270,200.394,0.223,3.347,0.276,30.423,0.254,300.431,0.084,4.384,0.251,40.392,0.226,400.273,0.278,5.341,0.182,50.513,0.218,500.538,0.152,6.583,0.274,60.574,0.173,600.736,0.254,7.408,0.300,70.489,0.264,700.386,0.291
99-
filter,>128KB,<1.1,22,35247,20784,1.489,0.325,10.447,0.281,100.478,0.320,2.343,0.261,20.326,0.249,200.506,0.250,3.306,0.229,30.519,0.239,300.492,0.285,4.462,0.253,40.420,0.215,400.380,0.244,5.520,0.329,50.422,0.301,500.354,0.269,6.368,0.270,60.446,0.289,600.340,0.261,7.504,0.311,70.457,0.293,700.497,0.274
100-
rangedel,48-128KB,>2.5,12,37516,18543,1.336,0.308,10.419,0.275,100.429,0.305,2.635,0.282,20.423,0.351,200.391,0.336,3.559,0.248,30.453,0.319,300.496,0.267,4.262,0.210,40.597,0.290,400.442,0.233,5.525,0.250,50.441,0.295,500.490,0.281,6.353,0.226,60.591,0.281,600.367,0.240,7.450,0.301,70.278,0.145,700.416,0.313
103+
Kind,Size Range,Test CR,Samples,Size,Size±,Snappy CR,Snappy CR±,Snappy Comp ns/b,Snappy Comp±,Snappy Decomp ns/b,Snappy Decomp±,MinLZ1 CR,MinLZ1 CR±,MinLZ1 Comp ns/b,MinLZ1 Comp±,MinLZ1 Decomp ns/b,MinLZ1 Decomp±,MinLZ2 CR,MinLZ2 CR±,MinLZ2 Comp ns/b,MinLZ2 Comp±,MinLZ2 Decomp ns/b,MinLZ2 Decomp±,ZSTD1 CR,ZSTD1 CR±,ZSTD1 Comp ns/b,ZSTD1 Comp±,ZSTD1 Decomp ns/b,ZSTD1 Decomp±,ZSTD3 CR,ZSTD3 CR±,ZSTD3 Comp ns/b,ZSTD3 Comp±,ZSTD3 Decomp ns/b,ZSTD3 Decomp±
104+
index,48-128KB,1.1-1.5,7,37065,26220,1.339,0.261,10.248,0.199,100.608,0.273,2.381,0.253,20.577,0.248,200.658,0.181,3.484,0.236,30.328,0.259,300.545,0.258,4.564,0.238,40.318,0.190,400.559,0.256,5.483,0.271,50.392,0.264,500.537,0.251
105+
index,>128KB,1.5-2.5,8,45983,17846,1.277,0.262,10.395,0.293,100.516,0.233,2.278,0.329,20.539,0.332,200.293,0.230,3.301,0.158,30.367,0.270,300.419,0.325,4.400,0.289,40.718,0.189,400.365,0.296,5.500,0.228,50.326,0.297,500.517,0.092
106+
sstval,24-48KB,>2.5,10,44208,18852,1.550,0.233,10.611,0.232,100.550,0.289,2.547,0.211,20.328,0.236,200.310,0.228,3.501,0.281,30.324,0.182,300.523,0.248,4.326,0.277,40.544,0.330,400.447,0.159,5.525,0.208,50.506,0.289,500.345,0.148
107+
blobval,<24KB,1.5-2.5,27,33328,19546,1.393,0.290,10.423,0.265,100.478,0.349,2.532,0.297,20.469,0.212,200.421,0.276,3.467,0.288,30.366,0.285,300.443,0.279,4.407,0.296,40.413,0.291,400.286,0.235,5.435,0.298,50.345,0.287,500.545,0.280
108+
,>128KB,1.5-2.5,10,21464,17903,1.344,0.296,10.555,0.304,100.435,0.290,2.415,0.308,20.402,0.238,200.436,0.287,3.555,0.251,30.393,0.314,300.452,0.263,4.354,0.272,40.461,0.328,400.539,0.254,5.371,0.253,50.352,0.263,500.412,0.300

‎sstable/compressionanalyzer/testdata/file_analyzer‎

Lines changed: 10 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -1,13 +1,13 @@
11
sst
22
../testdata/hamlet-sst/000002.sst
33
----
4-
Kind Size Range Test CR Samples Size Snappy MinLZ1 MinLZ2 ZSTD1 ZSTD3 ZSTD5 ZSTD7
5-
data <24KB 1.5-2.5 14 1.9KB ± 25% CR 1.93 ± 3% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0%
6-
Comp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
7-
Decomp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
8-
index <24KB 1.1-1.5 1 0.3KB ± 0% CR 1.31 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0%
9-
Comp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
10-
Decomp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
11-
rangedel <24KB 1.1-1.5 1 0.4KB ± 0% CR 1.28 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0%
12-
Comp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
13-
Decomp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
4+
Kind Size Range Test CR Samples Size Snappy MinLZ1 MinLZ2 ZSTD1 ZSTD3
5+
data <24KB 1.5-2.5 14 1.9KB ± 25% CR 1.93 ± 3% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0%
6+
Comp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
7+
Decomp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
8+
index <24KB 1.1-1.5 1 0.3KB ± 0% CR 1.31 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0%
9+
Comp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
10+
Decomp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
11+
rangedel <24KB 1.1-1.5 1 0.4KB ± 0% CR 1.28 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0% 0.00 ± 0%
12+
Comp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%
13+
Decomp 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0% 0MBps ± 0%

0 commit comments

Comments
 (0)