Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Homogeneise mlar extract -v output #185

Merged
merged 3 commits into from
Jan 8, 2024
Merged

Conversation

commial
Copy link
Contributor

@commial commial commented Dec 21, 2023

Outputs were inconsistent if linear extraction was or wasn't used.

@commial commial added the mlar Concerns the mlar utility label Dec 21, 2023
Copy link

Benchmark for 01a23ee

Click to view benchmark
Test Base PR %
chunk_size_decompress_mutilfiles_random/Layers(0x0)/1024 627.8±63.19ns 598.4±68.95ns -4.68%
chunk_size_decompress_mutilfiles_random/Layers(0x0)/1048576 53.3±2.84µs 53.5±6.18µs +0.38%
chunk_size_decompress_mutilfiles_random/Layers(0x0)/16777216 739.3±21.67µs 747.3±17.78µs +1.08%
chunk_size_decompress_mutilfiles_random/Layers(0x0)/65536 4.0±0.19µs 4.0±0.20µs 0.00%
chunk_size_decompress_mutilfiles_random/Layers(COMPRESS)/1024 816.3±453.91µs 819.7±454.12µs +0.42%
chunk_size_decompress_mutilfiles_random/Layers(COMPRESS)/1048576 41.2±0.09ms 41.1±0.09ms -0.24%
chunk_size_decompress_mutilfiles_random/Layers(COMPRESS)/16777216 165.0±5.48ms 163.8±0.50ms -0.73%
chunk_size_decompress_mutilfiles_random/Layers(COMPRESS)/65536 6.8±3.82ms 6.7±3.81ms -1.47%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT | COMPRESS)/1024 1072.9±593.94µs 1103.8±613.33µs +2.88%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT | COMPRESS)/1048576 40.6±0.07ms 40.7±0.07ms +0.25%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT | COMPRESS)/16777216 256.1±0.50ms 267.0±0.36ms +4.26%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT | COMPRESS)/65536 6.8±3.23ms 6.8±3.17ms 0.00%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT)/1024 841.0±203.36µs 795.3±175.33µs -5.43%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT)/1048576 9.0±0.21ms 8.0±0.21ms -11.11%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT)/16777216 131.1±0.23ms 116.0±0.41ms -11.52%
chunk_size_decompress_mutilfiles_random/Layers(ENCRYPT)/65536 1465.0±36.78µs 1340.9±19.86µs -8.47%
failsafe_multiple_layers_repair/Layers(0x0)/4194304 27.4±0.16ms 27.2±0.17ms -0.73%
failsafe_multiple_layers_repair/Layers(COMPRESS)/4194304 71.1±0.31ms 70.9±0.23ms -0.28%
failsafe_multiple_layers_repair/Layers(ENCRYPT | COMPRESS)/4194304 79.3±0.21ms 79.4±0.19ms +0.13%
failsafe_multiple_layers_repair/Layers(ENCRYPT)/4194304 38.2±0.31ms 38.2±0.29ms 0.00%
reader_multiple_layers_multiple_block_size/Layers(0x0)/1024 93.1±27.36ns 100.2±26.03ns +7.63%
reader_multiple_layers_multiple_block_size/Layers(0x0)/1048576 50.3±3.22µs 48.9±3.85µs -2.78%
reader_multiple_layers_multiple_block_size/Layers(0x0)/16777216 761.3±36.83µs 763.6±31.53µs +0.30%
reader_multiple_layers_multiple_block_size/Layers(0x0)/65536 3.1±0.19µs 3.2±0.18µs +3.23%
reader_multiple_layers_multiple_block_size/Layers(COMPRESS)/1024 3.3±2.65µs 3.3±2.66µs 0.00%
reader_multiple_layers_multiple_block_size/Layers(COMPRESS)/1048576 5.1±3.05ms 5.1±3.04ms 0.00%
reader_multiple_layers_multiple_block_size/Layers(COMPRESS)/16777216 125.5±11.17ms 123.0±0.29ms -1.99%
reader_multiple_layers_multiple_block_size/Layers(COMPRESS)/65536 214.8±172.29µs 215.2±172.47µs +0.19%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/1024 15.2±1.36µs 15.5±1.42µs +1.97%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/1048576 15.5±0.07ms 15.8±0.02ms +1.94%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/16777216 253.4±0.44ms 260.2±0.43ms +2.68%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/65536 934.2±77.50µs 959.3±78.08µs +2.69%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT)/1024 7.5±0.25µs 7.0±0.22µs -6.67%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT)/1048576 7.6±0.21ms 7.1±0.20ms -6.58%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT)/16777216 124.2±0.21ms 115.5±0.19ms -7.00%
reader_multiple_layers_multiple_block_size/Layers(ENCRYPT)/65536 476.8±15.74µs 443.2±14.06µs -7.05%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(0x0)/1024 482.6±11.92ns 476.8±13.79ns -1.20%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(0x0)/1048576 50.5±1.55µs 50.4±2.84µs -0.20%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(0x0)/16777216 719.0±25.89µs 730.1±27.48µs +1.54%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(0x0)/65536 3.7±0.13µs 3.9±0.68µs +5.41%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(COMPRESS)/1024 11.6±0.11µs 11.5±0.06µs -0.86%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(COMPRESS)/1048576 10.4±0.04ms 10.3±0.03ms -0.96%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(COMPRESS)/16777216 165.7±0.44ms 165.0±0.41ms -0.42%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(COMPRESS)/65536 645.4±1.42µs 645.7±3.11µs +0.05%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT | COMPRESS)/1024 17.6±0.18µs 18.2±0.13µs +3.41%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT | COMPRESS)/1048576 16.5±0.04ms 16.1±0.05ms -2.42%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT | COMPRESS)/16777216 262.9±0.48ms 256.3±0.40ms -2.51%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT | COMPRESS)/65536 1027.9±9.24µs 1002.0±6.25µs -2.52%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT)/1024 9.1±0.04µs 8.3±0.10µs -8.79%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT)/1048576 7.4±0.02ms 8.1±0.01ms +9.46%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT)/16777216 116.5±0.29ms 130.8±0.11ms +12.27%
reader_multiple_layers_multiple_block_size_multifiles_linear/Layers(ENCRYPT)/65536 496.7±17.88µs 471.6±14.61µs -5.05%
writer_multiple_layers_multiple_block_size/Layers(0x0)/1024 3.5±0.05µs 3.5±0.05µs 0.00%
writer_multiple_layers_multiple_block_size/Layers(0x0)/1048576 3.4±0.09ms 3.4±0.09ms 0.00%
writer_multiple_layers_multiple_block_size/Layers(0x0)/16777216 54.2±0.82ms 54.0±0.77ms -0.37%
writer_multiple_layers_multiple_block_size/Layers(0x0)/65536 210.5±6.16µs 210.0±6.18µs -0.24%
writer_multiple_layers_multiple_block_size/Layers(COMPRESS)/1024 6.7±0.46µs 6.1±0.22µs -8.96%
writer_multiple_layers_multiple_block_size/Layers(COMPRESS)/1048576 9.7±0.33ms 10.7±0.37ms +10.31%
writer_multiple_layers_multiple_block_size/Layers(COMPRESS)/16777216 323.5±1.36ms 325.1±1.70ms +0.49%
writer_multiple_layers_multiple_block_size/Layers(COMPRESS)/65536 432.1±33.16µs 426.8±34.93µs -1.23%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/1024 6.4±0.43µs 6.2±0.46µs -3.13%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/1048576 11.3±0.63ms 11.9±0.55ms +5.31%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/16777216 416.4±1.69ms 427.5±3.56ms +2.67%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT | COMPRESS)/65536 392.8±3.37µs 378.3±3.00µs -3.69%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT)/1024 11.2±0.08µs 11.7±0.14µs +4.46%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT)/1048576 10.7±0.07ms 11.3±0.09ms +5.61%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT)/16777216 171.3±0.53ms 180.0±0.60ms +5.08%
writer_multiple_layers_multiple_block_size/Layers(ENCRYPT)/65536 669.4±4.09µs 704.2±4.59µs +5.20%

@commial commial merged commit 5342417 into master Jan 8, 2024
24 checks passed
@commial commial deleted the verbose-linear-extract branch January 8, 2024 08:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
mlar Concerns the mlar utility
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant