Skip to content
This repository has been archived by the owner on May 7, 2024. It is now read-only.

Latest commit

 

History

History
2001 lines (1940 loc) · 72.4 KB

File metadata and controls

2001 lines (1940 loc) · 72.4 KB

Benchmark

Benchmark run from 2019-06-09 03:37:51.495009Z UTC

System

Benchmark suite executing on the following system:

Operating System macOS
CPU Information Intel(R) Core(TM) i7-6820HQ CPU @ 2.70GHz
Number of Available Cores 8
Available Memory 16 GB
Elixir Version 1.8.2
Erlang Version 21.3.8.2

Configuration

Benchmark suite executing with the following configuration:

:time 5 s
:parallel 4
:warmup 2 s

Statistics

Input: Blockchain

Run Time

Name IPS Average Devitation Median 99th %
jiffy 3.63 K 275.38 μs ±30.13% 251.90 μs 516.90 μs
serde_rustler 2.50 K 399.55 μs ±29.58% 344.90 μs 774.90 μs
Jason 1.80 K 556.56 μs ±9.13% 551.90 μs 771.90 μs
jsone 1.24 K 808.16 μs ±14.34% 802.90 μs 1257.90 μs
Tiny 1.05 K 950.31 μs ±14.46% 952.90 μs 1486.90 μs
Poison 0.85 K 1182.96 μs ±15.21% 1188.90 μs 1724.90 μs
JSX 0.78 K 1288.66 μs ±13.46% 1267.90 μs 1805.29 μs
JSON 0.39 K 2585.69 μs ±20.68% 2481.90 μs 4222.20 μs
serde_rustler (dirty) 0.27 K 3750.74 μs ±10.98% 3758.90 μs 4655.60 μs

Comparsion

Name IPS Slower
jiffy 3.63 K  
serde_rustler 2.50 K 1.45x
Jason 1.80 K 2.02x
jsone 1.24 K 2.93x
Tiny 1.05 K 3.45x
Poison 0.85 K 4.3x
JSX 0.78 K 4.68x
JSON 0.39 K 9.39x
serde_rustler (dirty) 0.27 K 13.62x

Memory Usage

Name Memory Factor
jiffy 1.52 KB  
serde_rustler 1.59 KB 1.05x
Jason 77.62 KB 50.95x
jsone 262.86 KB 172.54x
Tiny 326.70 KB 214.45x
Poison 540.09 KB 354.52x
JSX 550.15 KB 361.12x
JSON 1490.06 KB 978.09x
serde_rustler (dirty) 1.59 KB 1.05x

Input: Giphy

Run Time

Name IPS Average Devitation Median 99th %
jiffy 373.38 2.68 ms ±17.85% 2.54 ms 4.16 ms
Jason 175.77 5.69 ms ±6.49% 5.67 ms 6.92 ms
serde_rustler 114.08 8.77 ms ±52.48% 9.41 ms 16.50 ms
jsone 94.52 10.58 ms ±8.03% 10.35 ms 14.45 ms
Tiny 83.92 11.92 ms ±6.66% 11.83 ms 14.56 ms
Poison 71.85 13.92 ms ±6.64% 13.97 ms 16.39 ms
JSX 59.64 16.77 ms ±4.84% 16.65 ms 18.92 ms
JSON 29.75 33.61 ms ±4.25% 33.55 ms 37.60 ms
serde_rustler (dirty) 18.79 53.23 ms ±26.82% 43.94 ms 77.11 ms

Comparsion

Name IPS Slower
jiffy 373.38  
Jason 175.77 2.12x
serde_rustler 114.08 3.27x
jsone 94.52 3.95x
Tiny 83.92 4.45x
Poison 71.85 5.2x
JSX 59.64 6.26x
JSON 29.75 12.55x
serde_rustler (dirty) 18.79 19.88x

Memory Usage

Name Memory Factor
jiffy 0.40 MB  
Jason 1.12 MB 2.8x
serde_rustler 0.00153 MB 0.0x
jsone 3.43 MB 8.56x
Tiny 4.36 MB 10.88x
Poison 5.27 MB 13.13x
JSX 7.00 MB 17.47x
JSON 12.81 MB 31.93x
serde_rustler (dirty) 0.00153 MB 0.0x

Input: GitHub

Run Time

Name IPS Average Devitation Median 99th %
jiffy 1315.82 0.76 ms ±19.02% 0.75 ms 1.29 ms
serde_rustler 960.83 1.04 ms ±27.68% 0.88 ms 1.80 ms
Jason 625.62 1.60 ms ±6.67% 1.55 ms 2.12 ms
jsone 420.11 2.38 ms ±10.40% 2.32 ms 3.69 ms
Tiny 379.85 2.63 ms ±10.79% 2.58 ms 4.04 ms
Poison 292.15 3.42 ms ±9.49% 3.36 ms 5.17 ms
JSX 211.85 4.72 ms ±6.14% 4.67 ms 6.03 ms
JSON 110.72 9.03 ms ±6.13% 9.01 ms 11.01 ms
serde_rustler (dirty) 92.73 10.78 ms ±11.44% 10.72 ms 13.95 ms

Comparsion

Name IPS Slower
jiffy 1315.82  
serde_rustler 960.83 1.37x
Jason 625.62 2.1x
jsone 420.11 3.13x
Tiny 379.85 3.46x
Poison 292.15 4.5x
JSX 211.85 6.21x
JSON 110.72 11.88x
serde_rustler (dirty) 92.73 14.19x

Memory Usage

Name Memory Factor
jiffy 47.79 KB  
serde_rustler 1.59 KB 0.03x
Jason 191.90 KB 4.02x
jsone 678.27 KB 14.19x
Tiny 770.84 KB 16.13x
Poison 1280 KB 26.78x
JSX 2142.23 KB 44.83x
JSON 4747.14 KB 99.34x
serde_rustler (dirty) 1.59 KB 0.03x

Input: GovTrack

Run Time

Name IPS Average Devitation Median 99th %
jiffy 8.06 124.06 ms ±4.38% 123.77 ms 140.70 ms
Jason 5.86 170.57 ms ±2.26% 170.64 ms 179.73 ms
serde_rustler 3.15 317.37 ms ±55.21% 396.39 ms 537.82 ms
jsone 3.04 329.31 ms ±3.14% 330.57 ms 355.27 ms
Tiny 2.62 382.18 ms ±2.89% 382.23 ms 412.25 ms
Poison 1.84 544.00 ms ±2.07% 545.58 ms 561.21 ms
JSX 1.51 662.64 ms ±2.16% 665.79 ms 685.72 ms
serde_rustler (dirty) 0.85 1180.78 ms ±28.71% 1193.39 ms 1769.40 ms
JSON 0.54 1858.16 ms ±0.65% 1858.24 ms 1886.21 ms

Comparsion

Name IPS Slower
jiffy 8.06  
Jason 5.86 1.37x
serde_rustler 3.15 2.56x
jsone 3.04 2.65x
Tiny 2.62 3.08x
Poison 1.84 4.38x
JSX 1.51 5.34x
serde_rustler (dirty) 0.85 9.52x
JSON 0.54 14.98x

Memory Usage

Name Memory Factor
jiffy 25.41 MB  
Jason 18.04 MB 0.71x
serde_rustler 0.00155 MB 0.0x
jsone 60.35 MB 2.38x
Tiny 71.56 MB 2.82x
Poison 117.53 MB 4.63x
JSX 148.97 MB 5.86x
serde_rustler (dirty) 0.00155 MB 0.0x
JSON 347.70 MB 13.68x

Input: Issue 90

Run Time

Name IPS Average Devitation Median 99th %
serde_rustler 54.37 18.39 ms ±127.15% 15.95 ms 24.12 ms
serde_rustler (dirty) 44.39 22.53 ms ±5.00% 22.53 ms 25.25 ms
jiffy 37.01 27.02 ms ±4.76% 26.82 ms 31.29 ms
Jason 5.86 170.76 ms ±1.86% 169.89 ms 181.48 ms
Tiny 5.52 181.16 ms ±2.71% 180.96 ms 194.10 ms
jsone 5.24 190.67 ms ±2.89% 190.68 ms 205.84 ms
JSX 4.91 203.76 ms ±2.86% 204.18 ms 217.49 ms
Poison 4.37 228.83 ms ±3.21% 229.38 ms 246.86 ms
JSON 0.34 2912.91 ms ±1.58% 2905.44 ms 2969.06 ms

Comparsion

Name IPS Slower
serde_rustler 54.37  
serde_rustler (dirty) 44.39 1.22x
jiffy 37.01 1.47x
Jason 5.86 9.28x
Tiny 5.52 9.85x
jsone 5.24 10.37x
JSX 4.91 11.08x
Poison 4.37 12.44x
JSON 0.34 158.38x

Memory Usage

Name Memory Factor
serde_rustler 0.00153 MB  
serde_rustler (dirty) 0.00153 MB 1.0x
jiffy 0.0116 MB 7.61x
Jason 2.34 MB 1535.26x
Tiny 8.74 MB 5726.61x
jsone 5.76 MB 3774.05x
JSX 11.25 MB 7375.44x
Poison 4.89 MB 3205.97x
JSON 602.89 MB 395106.92x

Input: JSON Generator

Run Time

Name IPS Average Devitation Median 99th %
jiffy 332.38 3.01 ms ±27.81% 2.96 ms 4.87 ms
Jason 230.16 4.34 ms ±7.62% 4.37 ms 5.21 ms
serde_rustler 199.06 5.02 ms ±38.07% 4.52 ms 10.61 ms
jsone 138.25 7.23 ms ±8.29% 7.01 ms 9.65 ms
Tiny 119.06 8.40 ms ±7.20% 8.23 ms 10.85 ms
Poison 90.19 11.09 ms ±9.19% 10.77 ms 14.78 ms
JSX 81.83 12.22 ms ±6.44% 12.07 ms 14.49 ms
JSON 30.43 32.86 ms ±3.82% 32.80 ms 36.08 ms
serde_rustler (dirty) 24.71 40.47 ms ±26.86% 33.97 ms 63.25 ms

Comparsion

Name IPS Slower
jiffy 332.38  
Jason 230.16 1.44x
serde_rustler 199.06 1.67x
jsone 138.25 2.4x
Tiny 119.06 2.79x
Poison 90.19 3.69x
JSX 81.83 4.06x
JSON 30.43 10.92x
serde_rustler (dirty) 24.71 13.45x

Memory Usage

Name Memory Factor
jiffy 0.31 MB  
Jason 0.73 MB 2.38x
serde_rustler 0.00155 MB 0.01x
jsone 2.41 MB 7.87x
Tiny 3.05 MB 10.0x
Poison 4.77 MB 15.61x
JSX 5.17 MB 16.93x
JSON 13.59 MB 44.49x
serde_rustler (dirty) 0.00155 MB 0.01x

Input: JSON Generator (Pretty)

Run Time

Name IPS Average Devitation Median 99th %
jiffy 280.09 3.57 ms ±24.47% 3.30 ms 5.88 ms
serde_rustler 188.34 5.31 ms ±38.54% 4.79 ms 11.15 ms
Jason 187.93 5.32 ms ±6.26% 5.36 ms 6.36 ms
jsone 115.66 8.65 ms ±8.74% 8.31 ms 10.90 ms
Tiny 108.72 9.20 ms ±5.42% 9.16 ms 10.93 ms
Poison 80.56 12.41 ms ±7.33% 12.17 ms 15.60 ms
JSX 64.14 15.59 ms ±6.88% 15.60 ms 19.22 ms
JSON 29.98 33.36 ms ±4.43% 33.20 ms 36.99 ms
serde_rustler (dirty) 25.48 39.24 ms ±24.92% 33.65 ms 58.80 ms

Comparsion

Name IPS Slower
jiffy 280.09  
serde_rustler 188.34 1.49x
Jason 187.93 1.49x
jsone 115.66 2.42x
Tiny 108.72 2.58x
Poison 80.56 3.48x
JSX 64.14 4.37x
JSON 29.98 9.34x
serde_rustler (dirty) 25.48 10.99x

Memory Usage

Name Memory Factor
jiffy 0.55 MB  
serde_rustler 0.00154 MB 0.0x
Jason 0.73 MB 1.32x
jsone 2.40 MB 4.36x
Tiny 3.05 MB 5.53x
Poison 5.17 MB 9.37x
JSX 6.07 MB 11.01x
JSON 13.57 MB 24.61x
serde_rustler (dirty) 0.00154 MB 0.0x

Input: Pokedex

Run Time

Name IPS Average Devitation Median 99th %
Jason 409.52 2.44 ms ±8.42% 2.38 ms 3.13 ms
jiffy 381.32 2.62 ms ±24.18% 2.37 ms 4.19 ms
jsone 182.16 5.49 ms ±6.71% 5.37 ms 6.94 ms
serde_rustler 179.35 5.58 ms ±69.02% 3.28 ms 12.61 ms
Tiny 145.71 6.86 ms ±8.51% 6.70 ms 8.79 ms
Poison 124.74 8.02 ms ±8.58% 7.86 ms 10.14 ms
JSX 97.87 10.22 ms ±6.10% 10.16 ms 12.21 ms
JSON 44.76 22.34 ms ±4.48% 22.19 ms 25.66 ms
serde_rustler (dirty) 29.91 33.44 ms ±24.06% 28.76 ms 49.09 ms

Comparsion

Name IPS Slower
Jason 409.52  
jiffy 381.32 1.07x
jsone 182.16 2.25x
serde_rustler 179.35 2.28x
Tiny 145.71 2.81x
Poison 124.74 3.28x
JSX 97.87 4.18x
JSON 44.76 9.15x
serde_rustler (dirty) 29.91 13.69x

Memory Usage

Name Memory Factor
Jason 0.59 MB  
jiffy 0.108 MB 0.18x
jsone 2.00 MB 3.39x
serde_rustler 0.00153 MB 0.0x
Tiny 2.48 MB 4.19x
Poison 3.76 MB 6.35x
JSX 4.34 MB 7.34x
JSON 8.27 MB 13.98x
serde_rustler (dirty) 0.00153 MB 0.0x

Input: UTF-8 escaped

Run Time

Name IPS Average Devitation Median 99th %
jiffy 10590.01 0.0944 ms ±13.50% 0.0919 ms 0.155 ms
serde_rustler 5238.49 0.191 ms ±50.17% 0.186 ms 0.31 ms
serde_rustler (dirty) 4523.71 0.22 ms ±24.23% 0.188 ms 0.32 ms
Jason 601.23 1.66 ms ±17.18% 1.63 ms 2.39 ms
Poison 566.54 1.77 ms ±16.81% 1.63 ms 2.78 ms
jsone 492.66 2.03 ms ±16.03% 1.96 ms 3.70 ms
Tiny 454.94 2.20 ms ±13.90% 2.08 ms 3.20 ms
JSX 266.58 3.75 ms ±9.88% 3.60 ms 5.10 ms
JSON 175.02 5.71 ms ±9.07% 5.59 ms 7.36 ms

Comparsion

Name IPS Slower
jiffy 10590.01  
serde_rustler 5238.49 2.02x
serde_rustler (dirty) 4523.71 2.34x
Jason 601.23 17.61x
Poison 566.54 18.69x
jsone 492.66 21.5x
Tiny 454.94 23.28x
JSX 266.58 39.73x
JSON 175.02 60.51x

Memory Usage

Name Memory Factor
jiffy 0.00007 MB  
serde_rustler 0.00005 MB 0.67x
serde_rustler (dirty) 0.00005 MB 0.67x
Jason 0.43 MB 6249.11x
Poison 1.01 MB 14731.78x
jsone 1.13 MB 16409.11x
Tiny 1.14 MB 16555.56x
JSX 1.73 MB 25156.89x
JSON 3.19 MB 46424.33x

Input: UTF-8 unescaped

Run Time

Name IPS Average Devitation Median 99th %
serde_rustler 21.88 K 45.70 μs ±20.43% 43.90 μs 74.90 μs
serde_rustler (dirty) 16.17 K 61.84 μs ±40.44% 56.90 μs 102.90 μs
jiffy 12.50 K 80.01 μs ±53.59% 76.90 μs 132.90 μs
Jason 3.98 K 251.32 μs ±15.87% 234.90 μs 391.90 μs
jsone 2.81 K 356.46 μs ±14.57% 345.90 μs 593.90 μs
Poison 2.53 K 395.48 μs ±14.44% 393.90 μs 692.90 μs
JSX 2.49 K 401.72 μs ±13.79% 390.90 μs 642.90 μs
Tiny 1.58 K 631.39 μs ±14.86% 614.90 μs 1090.90 μs
JSON 1.08 K 925.65 μs ±25.58% 877.90 μs 1577.90 μs

Comparsion

Name IPS Slower
serde_rustler 21.88 K  
serde_rustler (dirty) 16.17 K 1.35x
jiffy 12.50 K 1.75x
Jason 3.98 K 5.5x
jsone 2.81 K 7.8x
Poison 2.53 K 8.65x
JSX 2.49 K 8.79x
Tiny 1.58 K 13.81x
JSON 1.08 K 20.25x

Memory Usage

Name Memory Factor
serde_rustler 0.0469 KB  
serde_rustler (dirty) 0.0469 KB 1.0x
jiffy 0.0703 KB 1.5x
Jason 15.39 KB 328.33x
jsone 37.04 KB 790.17x
Poison 43.42 KB 926.33x
JSX 92.83 KB 1980.33x
Tiny 244.49 KB 5215.83x
JSON 488.69 KB 10425.33x