Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark: TurboByte+TurboBitByte vs streamvbtyte #96

Open
powturbo opened this issue Mar 23, 2023 · 0 comments
Open

Benchmark: TurboByte+TurboBitByte vs streamvbtyte #96

powturbo opened this issue Mar 23, 2023 · 0 comments

Comments

@powturbo
Copy link
Owner

powturbo commented Mar 23, 2023

TurboBitByte (=TurboByte+TurboPack) compress considerably better and can be more than 3 times faster than streamvbyte.

icapp ZIPF -I15 -J15 -v0 -e45,50,55,130
zipf alpha=1.50 range[0..255].n=1000000

E MB/s     size    ratio   D MB/s function integer size=32 bits
27832     998869  24.97%   61563    50:v8nenc128v32     TurboBitByte
50693    1003267  25.08%   86389    55:v8nenc256v32     TurboBitByte
22740    1250000  31.25%   33114    45:v8enc32          TurboByte SIMD           
20622    1250000  31.25%   33616   130:streamvbyte      StreamVByte SIMD         

icapp ZIPF -I15 -J15 -v0 -e45,50,55,130 -M100m
zipf alpha=1.50 range[0..104857600].n=1000000
17707    1301157  32.53%   33095    45:v8enc32          TurboByte SIMD
13432    1301157  32.53%   33065   130:streamvbyte      StreamVByte SIMD            
13164    1305035  32.63%   30378    55:v8nenc256v32     TurboBitByte
11348    1305997  32.65%   27898    50:v8nenc128v32     TurboBitByte

icapp lz77offset.u32.u32 -I16 -J15 -v0 -e45,55,130
12085   23992643  51.42%   12928    55:v8nenc256v32     TurboBitByte
11617   24287565  52.05%   13023    45:v8enc32          TurboBitByte
10607   24287565  52.05%   12857   130:streamvbyte      StreamVByte SIMD        

icapp lz77length.txt -Fc -I16 -J15 -v0 -e45,50,55,130
19006   29011087  17.52%   13987    50:v8nenc128v32     TurboBitByte          
17199   30265912  18.28%   13372    55:v8nenc256v32     TurboBitByte         
12624   51783739  31.27%   13419    45:v8enc32          TurboByte SIMD              
11206   51783739  31.27%   13563   130:streamvbyte      StreamVByte SIMD         

icapp lz77length.txt -Fc -I16 -J15 -e49,51,56,132
10733   33467195  20.21%   11283    51:v8nzenc128v32    TurboBitByte zigzag       
12947   34771338  21.00%   11736    56:v8nzenc256v32    TurboBitByte zigzag        
12232   51893881  31.34%   12566    49:v8zenc32         TurboByte zigzag       
 3988   51893881  31.34%    4694   132:streamvbyte zzag StreamVByte zigzag     
@powturbo powturbo changed the title Benchmark: TurboByte vs streamvbtyte Benchmark: TurboByte+TurboBitByte vs streamvbtyte Apr 16, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant