/
ParquetNestedSchemaPruningBenchmark-results.txt
53 lines (45 loc) · 4.42 KB
/
ParquetNestedSchemaPruningBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
================================================================================================
Nested Schema Pruning Benchmark For Parquet
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 98 111 13 10.2 98.2 1.0X
Nested column 96 113 19 10.4 95.7 1.0X
Nested column in array 294 316 18 3.4 294.0 0.3X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 343 375 24 2.9 343.5 1.0X
Nested column 352 379 16 2.8 352.3 1.0X
Nested column in array 802 871 64 1.2 802.3 0.4X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 321 339 13 3.1 321.5 1.0X
Nested column 328 343 17 3.0 328.3 1.0X
Nested column in array 701 739 19 1.4 701.5 0.5X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 319 341 19 3.1 319.4 1.0X
Nested column 347 361 9 2.9 347.0 0.9X
Nested column in array 763 823 51 1.3 763.0 0.4X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 108 132 31 9.2 108.2 1.0X
Nested column 118 136 44 8.5 117.7 0.9X
Nested column in array 374 401 42 2.7 374.4 0.3X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 570 588 10 1.8 570.0 1.0X
Nested column 637 685 23 1.6 636.7 0.9X
Nested column in array 1098 1166 47 0.9 1097.7 0.5X