-
Notifications
You must be signed in to change notification settings - Fork 28k
/
WideSchemaBenchmark-results.txt
158 lines (134 loc) · 13.8 KB
/
WideSchemaBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
================================================================================================
parsing large select expressions
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 select expressions 2 2 1 0.0 1505391.0 1.0X
100 select expressions 7 9 1 0.0 6962661.0 0.2X
2500 select expressions 155 170 13 0.0 154743228.0 0.0X
================================================================================================
optimize large select expressions
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
optimize large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
100 columns 16 20 3 0.0 15946519.0 1.0X
1000 columns 138 150 10 0.0 138085198.0 0.1X
10000 columns 1431 1525 133 0.0 1430824032.0 0.0X
================================================================================================
many column field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 cols x 100000 rows (read in-mem) 24 31 4 4.1 241.3 1.0X
1 cols x 100000 rows (exec in-mem) 27 34 6 3.7 271.6 0.9X
1 cols x 100000 rows (read parquet) 49 66 29 2.1 485.6 0.5X
1 cols x 100000 rows (write parquet) 132 142 7 0.8 1315.4 0.2X
100 cols x 1000 rows (read in-mem) 32 39 6 3.1 324.0 0.7X
100 cols x 1000 rows (exec in-mem) 48 57 4 2.1 476.1 0.5X
100 cols x 1000 rows (read parquet) 50 67 15 2.0 496.5 0.5X
100 cols x 1000 rows (write parquet) 150 162 7 0.7 1502.9 0.2X
2500 cols x 40 rows (read in-mem) 252 273 15 0.4 2518.0 0.1X
2500 cols x 40 rows (exec in-mem) 522 537 12 0.2 5216.0 0.0X
2500 cols x 40 rows (read parquet) 862 887 22 0.1 8615.7 0.0X
2500 cols x 40 rows (write parquet) 331 359 35 0.3 3312.7 0.1X
================================================================================================
wide shallowly nested struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 44 52 9 2.3 437.5 1.0X
1 wide x 100000 rows (exec in-mem) 46 57 11 2.2 457.1 1.0X
1 wide x 100000 rows (read parquet) 54 66 13 1.8 541.2 0.8X
1 wide x 100000 rows (write parquet) 157 167 6 0.6 1569.2 0.3X
100 wide x 1000 rows (read in-mem) 32 41 8 3.1 323.9 1.4X
100 wide x 1000 rows (exec in-mem) 57 65 8 1.7 574.7 0.8X
100 wide x 1000 rows (read parquet) 51 60 15 1.9 514.8 0.8X
100 wide x 1000 rows (write parquet) 141 154 7 0.7 1406.8 0.3X
2500 wide x 40 rows (read in-mem) 45 51 7 2.2 450.3 1.0X
2500 wide x 40 rows (exec in-mem) 653 671 25 0.2 6532.9 0.1X
2500 wide x 40 rows (read parquet) 165 176 10 0.6 1647.3 0.3X
2500 wide x 40 rows (write parquet) 150 165 9 0.7 1502.7 0.3X
================================================================================================
deeply nested struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 deep x 100000 rows (read in-mem) 33 43 9 3.1 326.9 1.0X
1 deep x 100000 rows (exec in-mem) 39 48 7 2.6 391.0 0.8X
1 deep x 100000 rows (read parquet) 43 52 11 2.3 427.1 0.8X
1 deep x 100000 rows (write parquet) 150 164 10 0.7 1502.8 0.2X
100 deep x 1000 rows (read in-mem) 91 99 6 1.1 910.4 0.4X
100 deep x 1000 rows (exec in-mem) 798 826 25 0.1 7980.2 0.0X
100 deep x 1000 rows (read parquet) 754 770 20 0.1 7541.6 0.0X
100 deep x 1000 rows (write parquet) 208 224 26 0.5 2078.0 0.2X
250 deep x 400 rows (read in-mem) 376 389 10 0.3 3762.2 0.1X
250 deep x 400 rows (exec in-mem) 4969 5087 166 0.0 49689.9 0.0X
250 deep x 400 rows (read parquet) 4643 4690 66 0.0 46432.7 0.0X
250 deep x 400 rows (write parquet) 498 520 22 0.2 4979.6 0.1X
================================================================================================
bushy struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
1 x 1 deep x 100000 rows (read in-mem) 34 40 9 2.9 342.1 1.0X
1 x 1 deep x 100000 rows (exec in-mem) 39 47 8 2.5 392.9 0.9X
1 x 1 deep x 100000 rows (read parquet) 43 51 10 2.3 432.8 0.8X
1 x 1 deep x 100000 rows (write parquet) 151 163 7 0.7 1510.0 0.2X
128 x 8 deep x 1000 rows (read in-mem) 31 38 9 3.2 312.9 1.1X
128 x 8 deep x 1000 rows (exec in-mem) 66 77 7 1.5 660.3 0.5X
128 x 8 deep x 1000 rows (read parquet) 45 55 10 2.2 450.2 0.8X
128 x 8 deep x 1000 rows (write parquet) 142 154 8 0.7 1415.8 0.2X
1024 x 11 deep x 100 rows (read in-mem) 41 48 9 2.4 411.5 0.8X
1024 x 11 deep x 100 rows (exec in-mem) 434 465 33 0.2 4344.7 0.1X
1024 x 11 deep x 100 rows (read parquet) 89 99 10 1.1 885.1 0.4X
1024 x 11 deep x 100 rows (write parquet) 158 172 7 0.6 1584.5 0.2X
================================================================================================
wide array field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 34 39 3 3.0 338.0 1.0X
1 wide x 100000 rows (exec in-mem) 40 48 4 2.5 400.8 0.8X
1 wide x 100000 rows (read parquet) 46 53 13 2.2 461.1 0.7X
1 wide x 100000 rows (write parquet) 139 154 12 0.7 1388.3 0.2X
100 wide x 1000 rows (read in-mem) 30 36 8 3.3 302.2 1.1X
100 wide x 1000 rows (exec in-mem) 33 39 6 3.1 326.2 1.0X
100 wide x 1000 rows (read parquet) 38 46 9 2.6 378.9 0.9X
100 wide x 1000 rows (write parquet) 132 147 10 0.8 1323.2 0.3X
2500 wide x 40 rows (read in-mem) 26 32 6 3.8 263.1 1.3X
2500 wide x 40 rows (exec in-mem) 32 38 7 3.1 323.3 1.0X
2500 wide x 40 rows (read parquet) 37 46 11 2.7 374.1 0.9X
2500 wide x 40 rows (write parquet) 141 148 5 0.7 1410.3 0.2X
================================================================================================
wide map field read and write
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 29 34 3 3.4 294.3 1.0X
1 wide x 100000 rows (exec in-mem) 40 45 6 2.5 401.7 0.7X
1 wide x 100000 rows (read parquet) 49 58 10 2.1 486.3 0.6X
1 wide x 100000 rows (write parquet) 137 146 4 0.7 1366.6 0.2X
100 wide x 1000 rows (read in-mem) 19 23 4 5.2 190.6 1.5X
100 wide x 1000 rows (exec in-mem) 21 27 4 4.7 214.9 1.4X
100 wide x 1000 rows (read parquet) 47 54 12 2.1 470.9 0.6X
100 wide x 1000 rows (write parquet) 130 137 7 0.8 1295.0 0.2X
2500 wide x 40 rows (read in-mem) 22 26 6 4.6 215.4 1.4X
2500 wide x 40 rows (exec in-mem) 27 32 5 3.7 271.5 1.1X
2500 wide x 40 rows (read parquet) 46 53 7 2.2 464.1 0.6X
2500 wide x 40 rows (write parquet) 133 142 5 0.8 1329.6 0.2X