/
ParquetNestedSchemaPruningBenchmark-results.txt
53 lines (45 loc) · 4.44 KB
/
ParquetNestedSchemaPruningBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
================================================================================================
Nested Schema Pruning Benchmark For Parquet
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Selection: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 56 62 5 17.8 56.1 1.0X
Nested column 291 306 9 3.4 291.0 0.2X
Nested column in array 1126 1166 24 0.9 1126.1 0.0X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Limiting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 372 399 28 2.7 371.9 1.0X
Nested column 686 724 27 1.5 686.0 0.5X
Nested column in array 1892 1973 72 0.5 1892.0 0.2X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Repartitioning: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 351 361 6 2.9 350.6 1.0X
Nested column 661 677 8 1.5 660.6 0.5X
Nested column in array 1886 1935 41 0.5 1886.3 0.2X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Repartitioning by exprs: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 322 343 15 3.1 322.2 1.0X
Nested column 686 712 23 1.5 686.4 0.5X
Nested column in array 1813 1918 67 0.6 1813.1 0.2X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Sample: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 81 92 8 12.3 81.2 1.0X
Nested column 331 393 42 3.0 330.6 0.2X
Nested column in array 1209 1324 70 0.8 1209.5 0.1X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Sorting: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Top-level column 475 482 4 2.1 475.1 1.0X
Nested column 843 883 17 1.2 843.2 0.6X
Nested column in array 1895 1936 33 0.5 1895.1 0.3X