-
Notifications
You must be signed in to change notification settings - Fork 28k
/
WideSchemaBenchmark-results.txt
145 lines (124 loc) · 13 KB
/
WideSchemaBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
================================================================================================
parsing large select expressions
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 select expressions 5 13 8 0.0 5370143.0 1.0X
100 select expressions 12 16 6 0.0 11995425.0 0.4X
2500 select expressions 211 214 4 0.0 210927791.0 0.0X
================================================================================================
many column field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 cols x 100000 rows (read in-mem) 44 53 6 2.3 440.3 1.0X
1 cols x 100000 rows (exec in-mem) 44 54 9 2.3 437.0 1.0X
1 cols x 100000 rows (read parquet) 53 61 10 1.9 532.4 0.8X
1 cols x 100000 rows (write parquet) 129 142 36 0.8 1291.6 0.3X
100 cols x 1000 rows (read in-mem) 49 55 7 2.0 494.9 0.9X
100 cols x 1000 rows (exec in-mem) 69 73 5 1.4 693.2 0.6X
100 cols x 1000 rows (read parquet) 60 67 8 1.7 596.3 0.7X
100 cols x 1000 rows (write parquet) 142 156 31 0.7 1417.8 0.3X
2500 cols x 40 rows (read in-mem) 391 399 13 0.3 3912.6 0.1X
2500 cols x 40 rows (exec in-mem) 743 749 8 0.1 7432.5 0.1X
2500 cols x 40 rows (read parquet) 297 310 10 0.3 2972.8 0.1X
2500 cols x 40 rows (write parquet) 485 492 16 0.2 4848.1 0.1X
================================================================================================
wide shallowly nested struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 43 48 6 2.3 427.0 1.0X
1 wide x 100000 rows (exec in-mem) 56 63 8 1.8 557.8 0.8X
1 wide x 100000 rows (read parquet) 82 88 10 1.2 818.6 0.5X
1 wide x 100000 rows (write parquet) 134 145 21 0.7 1344.6 0.3X
100 wide x 1000 rows (read in-mem) 55 61 16 1.8 553.1 0.8X
100 wide x 1000 rows (exec in-mem) 94 101 17 1.1 941.4 0.5X
100 wide x 1000 rows (read parquet) 151 179 29 0.7 1511.7 0.3X
100 wide x 1000 rows (write parquet) 147 157 9 0.7 1470.0 0.3X
2500 wide x 40 rows (read in-mem) 66 69 9 1.5 658.9 0.6X
2500 wide x 40 rows (exec in-mem) 853 871 30 0.1 8525.7 0.1X
2500 wide x 40 rows (read parquet) 1158 1296 195 0.1 11577.8 0.0X
2500 wide x 40 rows (write parquet) 157 173 23 0.6 1569.6 0.3X
================================================================================================
deeply nested struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 deep x 100000 rows (read in-mem) 37 41 6 2.7 374.5 1.0X
1 deep x 100000 rows (exec in-mem) 47 50 6 2.1 466.9 0.8X
1 deep x 100000 rows (read parquet) 58 61 7 1.7 577.7 0.6X
1 deep x 100000 rows (write parquet) 128 134 18 0.8 1282.2 0.3X
100 deep x 1000 rows (read in-mem) 345 350 5 0.3 3447.8 0.1X
100 deep x 1000 rows (exec in-mem) 1283 1283 0 0.1 12830.5 0.0X
100 deep x 1000 rows (read parquet) 1201 1205 7 0.1 12005.2 0.0X
100 deep x 1000 rows (write parquet) 436 443 9 0.2 4361.4 0.1X
250 deep x 400 rows (read in-mem) 1882 1883 1 0.1 18819.9 0.0X
250 deep x 400 rows (exec in-mem) 7705 7709 5 0.0 77054.4 0.0X
250 deep x 400 rows (read parquet) 7052 7087 50 0.0 70517.1 0.0X
250 deep x 400 rows (write parquet) 1978 1979 1 0.1 19780.3 0.0X
================================================================================================
bushy struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 x 1 deep x 100000 rows (read in-mem) 34 39 7 2.9 341.5 1.0X
1 x 1 deep x 100000 rows (exec in-mem) 42 45 5 2.4 423.4 0.8X
1 x 1 deep x 100000 rows (read parquet) 42 45 6 2.4 423.8 0.8X
1 x 1 deep x 100000 rows (write parquet) 124 132 19 0.8 1240.4 0.3X
128 x 8 deep x 1000 rows (read in-mem) 39 42 6 2.6 387.3 0.9X
128 x 8 deep x 1000 rows (exec in-mem) 134 138 6 0.7 1342.5 0.3X
128 x 8 deep x 1000 rows (read parquet) 147 164 27 0.7 1468.2 0.2X
128 x 8 deep x 1000 rows (write parquet) 130 142 34 0.8 1297.7 0.3X
1024 x 11 deep x 100 rows (read in-mem) 64 68 11 1.6 639.3 0.5X
1024 x 11 deep x 100 rows (exec in-mem) 642 652 14 0.2 6416.9 0.1X
1024 x 11 deep x 100 rows (read parquet) 527 531 5 0.2 5268.1 0.1X
1024 x 11 deep x 100 rows (write parquet) 155 166 28 0.6 1545.0 0.2X
================================================================================================
wide array field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 36 39 5 2.7 364.2 1.0X
1 wide x 100000 rows (exec in-mem) 46 50 7 2.2 460.4 0.8X
1 wide x 100000 rows (read parquet) 75 78 8 1.3 749.8 0.5X
1 wide x 100000 rows (write parquet) 127 133 19 0.8 1266.0 0.3X
100 wide x 1000 rows (read in-mem) 31 33 4 3.2 309.9 1.2X
100 wide x 1000 rows (exec in-mem) 40 42 4 2.5 397.3 0.9X
100 wide x 1000 rows (read parquet) 49 52 7 2.0 488.6 0.7X
100 wide x 1000 rows (write parquet) 122 135 23 0.8 1216.2 0.3X
2500 wide x 40 rows (read in-mem) 31 32 3 3.3 305.7 1.2X
2500 wide x 40 rows (exec in-mem) 39 42 5 2.6 391.9 0.9X
2500 wide x 40 rows (read parquet) 48 51 7 2.1 482.9 0.8X
2500 wide x 40 rows (write parquet) 120 130 22 0.8 1203.6 0.3X
================================================================================================
wide map field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_232-8u232-b09-0ubuntu1~18.04.1-b09 on Linux 4.15.0-1044-aws
Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 35 40 8 2.9 348.8 1.0X
1 wide x 100000 rows (exec in-mem) 46 47 2 2.2 461.8 0.8X
1 wide x 100000 rows (read parquet) 124 127 7 0.8 1236.1 0.3X
1 wide x 100000 rows (write parquet) 125 138 26 0.8 1245.4 0.3X
100 wide x 1000 rows (read in-mem) 26 35 8 3.8 263.1 1.3X
100 wide x 1000 rows (exec in-mem) 35 41 10 2.8 351.8 1.0X
100 wide x 1000 rows (read parquet) 59 62 8 1.7 586.7 0.6X
100 wide x 1000 rows (write parquet) 116 125 32 0.9 1158.2 0.3X
2500 wide x 40 rows (read in-mem) 27 30 5 3.7 270.2 1.3X
2500 wide x 40 rows (exec in-mem) 37 38 3 2.7 366.4 1.0X
2500 wide x 40 rows (read parquet) 58 62 8 1.7 584.3 0.6X
2500 wide x 40 rows (write parquet) 118 126 24 0.9 1176.1 0.3X