-
Notifications
You must be signed in to change notification settings - Fork 28k
/
DataSourceReadBenchmark-jdk11-results.txt
431 lines (385 loc) · 42.3 KB
/
DataSourceReadBenchmark-jdk11-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
================================================================================================
SQL Single Numeric Column Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single BOOLEAN Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 10669 10822 217 1.5 678.3 1.0X
SQL Json 8770 8900 184 1.8 557.6 1.2X
SQL Parquet Vectorized: DataPageV1 126 151 21 124.5 8.0 84.5X
SQL Parquet Vectorized: DataPageV2 94 113 18 166.9 6.0 113.2X
SQL Parquet MR: DataPageV1 2259 2263 6 7.0 143.6 4.7X
SQL Parquet MR: DataPageV2 1958 1973 21 8.0 124.5 5.5X
SQL ORC Vectorized 170 201 44 92.5 10.8 62.7X
SQL ORC MR 1647 1652 8 9.6 104.7 6.5X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Parquet Reader Single BOOLEAN Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized: DataPageV1 141 147 10 111.2 9.0 1.0X
ParquetReader Vectorized: DataPageV2 122 130 10 128.5 7.8 1.2X
ParquetReader Vectorized -> Row: DataPageV1 54 56 2 290.9 3.4 2.6X
ParquetReader Vectorized -> Row: DataPageV2 35 37 3 449.6 2.2 4.0X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 13773 13798 34 1.1 875.7 1.0X
SQL Json 9947 9952 7 1.6 632.4 1.4X
SQL Parquet Vectorized: DataPageV1 137 156 24 115.1 8.7 100.8X
SQL Parquet Vectorized: DataPageV2 134 147 16 117.6 8.5 103.0X
SQL Parquet MR: DataPageV1 2458 2483 35 6.4 156.3 5.6X
SQL Parquet MR: DataPageV2 2215 2216 0 7.1 140.9 6.2X
SQL ORC Vectorized 216 252 29 72.8 13.7 63.7X
SQL ORC MR 1544 1558 20 10.2 98.2 8.9X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Parquet Reader Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized: DataPageV1 189 195 6 83.1 12.0 1.0X
ParquetReader Vectorized: DataPageV2 186 194 12 84.5 11.8 1.0X
ParquetReader Vectorized -> Row: DataPageV1 92 94 4 171.3 5.8 2.1X
ParquetReader Vectorized -> Row: DataPageV2 92 94 4 171.6 5.8 2.1X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 14500 14515 20 1.1 921.9 1.0X
SQL Json 10406 10412 7 1.5 661.6 1.4X
SQL Parquet Vectorized: DataPageV1 167 218 37 94.3 10.6 86.9X
SQL Parquet Vectorized: DataPageV2 182 213 32 86.5 11.6 79.7X
SQL Parquet MR: DataPageV1 2674 2701 39 5.9 170.0 5.4X
SQL Parquet MR: DataPageV2 2327 2328 2 6.8 147.9 6.2X
SQL ORC Vectorized 221 269 31 71.2 14.1 65.6X
SQL ORC MR 1744 1745 1 9.0 110.9 8.3X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Parquet Reader Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized: DataPageV1 256 263 12 61.4 16.3 1.0X
ParquetReader Vectorized: DataPageV2 272 274 4 57.8 17.3 0.9X
ParquetReader Vectorized -> Row: DataPageV1 235 266 26 66.9 15.0 1.1X
ParquetReader Vectorized -> Row: DataPageV2 253 280 29 62.2 16.1 1.0X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 15885 15891 8 1.0 1009.9 1.0X
SQL Json 11115 11117 3 1.4 706.7 1.4X
SQL Parquet Vectorized: DataPageV1 155 204 45 101.8 9.8 102.8X
SQL Parquet Vectorized: DataPageV2 361 381 31 43.6 22.9 44.0X
SQL Parquet MR: DataPageV1 2641 2691 71 6.0 167.9 6.0X
SQL Parquet MR: DataPageV2 2367 2396 41 6.6 150.5 6.7X
SQL ORC Vectorized 272 315 26 57.8 17.3 58.3X
SQL ORC MR 1804 1819 21 8.7 114.7 8.8X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Parquet Reader Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized: DataPageV1 242 249 9 64.9 15.4 1.0X
ParquetReader Vectorized: DataPageV2 416 428 28 37.9 26.4 0.6X
ParquetReader Vectorized -> Row: DataPageV1 220 256 24 71.6 14.0 1.1X
ParquetReader Vectorized -> Row: DataPageV2 430 437 7 36.6 27.3 0.6X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 20514 20515 1 0.8 1304.3 1.0X
SQL Json 13789 13790 2 1.1 876.7 1.5X
SQL Parquet Vectorized: DataPageV1 258 280 40 61.0 16.4 79.6X
SQL Parquet Vectorized: DataPageV2 463 473 10 34.0 29.4 44.3X
SQL Parquet MR: DataPageV1 2813 2814 2 5.6 178.8 7.3X
SQL Parquet MR: DataPageV2 2511 2549 54 6.3 159.7 8.2X
SQL ORC Vectorized 416 420 3 37.8 26.4 49.3X
SQL ORC MR 1997 2010 19 7.9 127.0 10.3X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Parquet Reader Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized: DataPageV1 341 358 29 46.1 21.7 1.0X
ParquetReader Vectorized: DataPageV2 587 595 9 26.8 37.3 0.6X
ParquetReader Vectorized -> Row: DataPageV1 326 341 7 48.2 20.7 1.0X
ParquetReader Vectorized -> Row: DataPageV2 530 537 7 29.7 33.7 0.6X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 16432 16474 59 1.0 1044.7 1.0X
SQL Json 12323 12334 16 1.3 783.5 1.3X
SQL Parquet Vectorized: DataPageV1 150 186 29 104.7 9.6 109.4X
SQL Parquet Vectorized: DataPageV2 148 186 32 106.4 9.4 111.2X
SQL Parquet MR: DataPageV1 2642 2676 48 6.0 168.0 6.2X
SQL Parquet MR: DataPageV2 2507 2528 31 6.3 159.4 6.6X
SQL ORC Vectorized 398 409 16 39.5 25.3 41.3X
SQL ORC MR 1919 1929 15 8.2 122.0 8.6X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Parquet Reader Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized: DataPageV1 241 244 1 65.3 15.3 1.0X
ParquetReader Vectorized: DataPageV2 240 247 9 65.6 15.2 1.0X
ParquetReader Vectorized -> Row: DataPageV1 218 250 27 72.0 13.9 1.1X
ParquetReader Vectorized -> Row: DataPageV2 218 245 26 72.1 13.9 1.1X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 21387 21470 118 0.7 1359.7 1.0X
SQL Json 16560 16580 29 0.9 1052.9 1.3X
SQL Parquet Vectorized: DataPageV1 258 272 14 61.1 16.4 83.0X
SQL Parquet Vectorized: DataPageV2 217 262 21 72.5 13.8 98.6X
SQL Parquet MR: DataPageV1 2823 2855 45 5.6 179.5 7.6X
SQL Parquet MR: DataPageV2 2703 2712 12 5.8 171.9 7.9X
SQL ORC Vectorized 428 458 26 36.8 27.2 50.0X
SQL ORC MR 2068 2085 25 7.6 131.5 10.3X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Parquet Reader Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
ParquetReader Vectorized: DataPageV1 339 365 32 46.4 21.6 1.0X
ParquetReader Vectorized: DataPageV2 338 377 30 46.5 21.5 1.0X
ParquetReader Vectorized -> Row: DataPageV1 328 343 11 47.9 20.9 1.0X
ParquetReader Vectorized -> Row: DataPageV2 329 341 11 47.9 20.9 1.0X
================================================================================================
SQL Single Numeric Column Scan in Struct
================================================================================================
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single TINYINT Column Scan in Struct: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL ORC MR 2364 2369 7 6.7 150.3 1.0X
SQL ORC Vectorized (Nested Column Disabled) 2367 2367 1 6.6 150.5 1.0X
SQL ORC Vectorized (Nested Column Enabled) 299 343 37 52.6 19.0 7.9X
SQL Parquet MR: DataPageV1 2911 2960 68 5.4 185.1 0.8X
SQL Parquet Vectorized: DataPageV1 (Nested Column Disabled) 3443 3444 1 4.6 218.9 0.7X
SQL Parquet Vectorized: DataPageV1 (Nested Column Enabled) 162 199 48 96.8 10.3 14.6X
SQL Parquet MR: DataPageV2 2819 2835 23 5.6 179.2 0.8X
SQL Parquet Vectorized: DataPageV2 (Nested Column Disabled) 3291 3303 17 4.8 209.2 0.7X
SQL Parquet Vectorized: DataPageV2 (Nested Column Enabled) 162 192 38 97.1 10.3 14.6X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single SMALLINT Column Scan in Struct: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL ORC MR 2496 2508 18 6.3 158.7 1.0X
SQL ORC Vectorized (Nested Column Disabled) 2475 2480 7 6.4 157.4 1.0X
SQL ORC Vectorized (Nested Column Enabled) 413 453 38 38.1 26.3 6.0X
SQL Parquet MR: DataPageV1 3111 3162 72 5.1 197.8 0.8X
SQL Parquet Vectorized: DataPageV1 (Nested Column Disabled) 3723 3751 40 4.2 236.7 0.7X
SQL Parquet Vectorized: DataPageV1 (Nested Column Enabled) 204 245 33 77.2 12.9 12.3X
SQL Parquet MR: DataPageV2 2865 2869 6 5.5 182.2 0.9X
SQL Parquet Vectorized: DataPageV2 (Nested Column Disabled) 3441 3469 39 4.6 218.8 0.7X
SQL Parquet Vectorized: DataPageV2 (Nested Column Enabled) 257 299 29 61.1 16.4 9.7X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single INT Column Scan in Struct: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL ORC MR 2534 2550 23 6.2 161.1 1.0X
SQL ORC Vectorized (Nested Column Disabled) 2530 2544 20 6.2 160.9 1.0X
SQL ORC Vectorized (Nested Column Enabled) 425 466 26 37.0 27.0 6.0X
SQL Parquet MR: DataPageV1 3183 3244 86 4.9 202.4 0.8X
SQL Parquet Vectorized: DataPageV1 (Nested Column Disabled) 3800 3822 31 4.1 241.6 0.7X
SQL Parquet Vectorized: DataPageV1 (Nested Column Enabled) 221 281 52 71.2 14.0 11.5X
SQL Parquet MR: DataPageV2 2951 2986 49 5.3 187.6 0.9X
SQL Parquet Vectorized: DataPageV2 (Nested Column Disabled) 3530 3556 37 4.5 224.4 0.7X
SQL Parquet Vectorized: DataPageV2 (Nested Column Enabled) 424 444 20 37.1 27.0 6.0X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single BIGINT Column Scan in Struct: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL ORC MR 2709 2714 7 5.8 172.3 1.0X
SQL ORC Vectorized (Nested Column Disabled) 2770 2822 73 5.7 176.1 1.0X
SQL ORC Vectorized (Nested Column Enabled) 558 595 29 28.2 35.5 4.9X
SQL Parquet MR: DataPageV1 3229 3245 23 4.9 205.3 0.8X
SQL Parquet Vectorized: DataPageV1 (Nested Column Disabled) 3826 3872 65 4.1 243.2 0.7X
SQL Parquet Vectorized: DataPageV1 (Nested Column Enabled) 352 417 38 44.7 22.4 7.7X
SQL Parquet MR: DataPageV2 3033 3065 46 5.2 192.8 0.9X
SQL Parquet Vectorized: DataPageV2 (Nested Column Disabled) 3582 3621 56 4.4 227.7 0.8X
SQL Parquet Vectorized: DataPageV2 (Nested Column Enabled) 513 526 17 30.7 32.6 5.3X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single FLOAT Column Scan in Struct: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL ORC MR 2595 2627 46 6.1 165.0 1.0X
SQL ORC Vectorized (Nested Column Disabled) 2637 2643 8 6.0 167.6 1.0X
SQL ORC Vectorized (Nested Column Enabled) 576 582 7 27.3 36.6 4.5X
SQL Parquet MR: DataPageV1 3112 3113 1 5.1 197.8 0.8X
SQL Parquet Vectorized: DataPageV1 (Nested Column Disabled) 3687 3764 109 4.3 234.4 0.7X
SQL Parquet Vectorized: DataPageV1 (Nested Column Enabled) 164 207 35 96.0 10.4 15.8X
SQL Parquet MR: DataPageV2 2956 2957 2 5.3 187.9 0.9X
SQL Parquet Vectorized: DataPageV2 (Nested Column Disabled) 3468 3525 80 4.5 220.5 0.7X
SQL Parquet Vectorized: DataPageV2 (Nested Column Enabled) 164 198 30 96.1 10.4 15.8X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Single DOUBLE Column Scan in Struct: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL ORC MR 2743 2801 83 5.7 174.4 1.0X
SQL ORC Vectorized (Nested Column Disabled) 2813 2852 55 5.6 178.8 1.0X
SQL ORC Vectorized (Nested Column Enabled) 675 679 4 23.3 42.9 4.1X
SQL Parquet MR: DataPageV1 3229 3239 14 4.9 205.3 0.8X
SQL Parquet Vectorized: DataPageV1 (Nested Column Disabled) 3841 3890 69 4.1 244.2 0.7X
SQL Parquet Vectorized: DataPageV1 (Nested Column Enabled) 293 368 55 53.7 18.6 9.4X
SQL Parquet MR: DataPageV2 3110 3116 8 5.1 197.7 0.9X
SQL Parquet Vectorized: DataPageV2 (Nested Column Disabled) 3665 3679 20 4.3 233.0 0.7X
SQL Parquet Vectorized: DataPageV2 (Nested Column Enabled) 286 297 12 55.1 18.2 9.6X
================================================================================================
SQL Nested Column Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
SQL Nested Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------
SQL ORC MR 21196 21238 47 0.0 20213.9 1.0X
SQL ORC Vectorized (Nested Column Disabled) 21195 21235 45 0.0 20213.3 1.0X
SQL ORC Vectorized (Nested Column Enabled) 10184 10300 85 0.1 9712.1 2.1X
SQL Parquet MR: DataPageV1 17260 17386 108 0.1 16460.5 1.2X
SQL Parquet Vectorized: DataPageV1 (Nested Column Disabled) 17604 17651 37 0.1 16788.6 1.2X
SQL Parquet Vectorized: DataPageV1 (Nested Column Enabled) 10907 10984 68 0.1 10402.2 1.9X
SQL Parquet MR: DataPageV2 16540 16562 15 0.1 15774.2 1.3X
SQL Parquet Vectorized: DataPageV2 (Nested Column Disabled) 17341 17379 32 0.1 16537.9 1.2X
SQL Parquet Vectorized: DataPageV2 (Nested Column Enabled) 7990 8528 421 0.1 7619.5 2.7X
================================================================================================
Int and String Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 14699 14714 21 0.7 1401.8 1.0X
SQL Json 11673 11679 8 0.9 1113.3 1.3X
SQL Parquet Vectorized: DataPageV1 2115 2161 66 5.0 201.7 7.0X
SQL Parquet Vectorized: DataPageV2 2467 2509 59 4.3 235.3 6.0X
SQL Parquet MR: DataPageV1 4815 4856 58 2.2 459.2 3.1X
SQL Parquet MR: DataPageV2 4649 4662 19 2.3 443.4 3.2X
SQL ORC Vectorized 2177 2183 9 4.8 207.6 6.8X
SQL ORC MR 3689 3711 32 2.8 351.8 4.0X
================================================================================================
Repeated String Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 8010 8024 20 1.3 763.9 1.0X
SQL Json 7022 7040 26 1.5 669.6 1.1X
SQL Parquet Vectorized: DataPageV1 601 624 21 17.4 57.3 13.3X
SQL Parquet Vectorized: DataPageV2 603 622 18 17.4 57.5 13.3X
SQL Parquet MR: DataPageV1 2205 2218 19 4.8 210.3 3.6X
SQL Parquet MR: DataPageV2 2106 2109 4 5.0 200.9 3.8X
SQL ORC Vectorized 532 541 8 19.7 50.7 15.1X
SQL ORC MR 1923 1930 10 5.5 183.4 4.2X
================================================================================================
Partitioned Table Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
Data column - CSV 20469 20498 42 0.8 1301.4 1.0X
Data column - Json 13118 13124 7 1.2 834.0 1.6X
Data column - Parquet Vectorized: DataPageV1 261 279 24 60.4 16.6 78.6X
Data column - Parquet Vectorized: DataPageV2 498 522 19 31.6 31.7 41.1X
Data column - Parquet MR: DataPageV1 3283 3285 2 4.8 208.7 6.2X
Data column - Parquet MR: DataPageV2 3151 3153 3 5.0 200.3 6.5X
Data column - ORC Vectorized 416 436 18 37.8 26.5 49.2X
Data column - ORC MR 2376 2383 10 6.6 151.1 8.6X
Partition column - CSV 6674 6675 2 2.4 424.3 3.1X
Partition column - Json 10431 10436 7 1.5 663.2 2.0X
Partition column - Parquet Vectorized: DataPageV1 42 63 18 373.0 2.7 485.5X
Partition column - Parquet Vectorized: DataPageV2 41 58 18 381.1 2.6 496.0X
Partition column - Parquet MR: DataPageV1 1624 1628 5 9.7 103.3 12.6X
Partition column - Parquet MR: DataPageV2 1645 1647 2 9.6 104.6 12.4X
Partition column - ORC Vectorized 43 61 20 363.4 2.8 472.9X
Partition column - ORC MR 1462 1464 2 10.8 93.0 14.0X
Both columns - CSV 20557 20557 1 0.8 1307.0 1.0X
Both columns - Json 13619 13626 9 1.2 865.9 1.5X
Both columns - Parquet Vectorized: DataPageV1 268 318 30 58.7 17.0 76.3X
Both columns - Parquet Vectorized: DataPageV2 529 556 22 29.7 33.6 38.7X
Both columns - Parquet MR: DataPageV1 3304 3332 40 4.8 210.1 6.2X
Both columns - Parquet MR: DataPageV2 3163 3185 30 5.0 201.1 6.5X
Both columns - ORC Vectorized 402 411 10 39.1 25.6 50.9X
Both columns - ORC MR 2456 2473 24 6.4 156.1 8.3X
================================================================================================
String with Nulls Scan
================================================================================================
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 9601 9644 61 1.1 915.6 1.0X
SQL Json 10737 10741 6 1.0 1024.0 0.9X
SQL Parquet Vectorized: DataPageV1 1274 1327 76 8.2 121.5 7.5X
SQL Parquet Vectorized: DataPageV2 1894 1900 8 5.5 180.6 5.1X
SQL Parquet MR: DataPageV1 4369 4371 2 2.4 416.7 2.2X
SQL Parquet MR: DataPageV2 4481 4482 2 2.3 427.3 2.1X
ParquetReader Vectorized: DataPageV1 937 978 38 11.2 89.4 10.2X
ParquetReader Vectorized: DataPageV2 1550 1552 3 6.8 147.8 6.2X
SQL ORC Vectorized 1120 1186 92 9.4 106.8 8.6X
SQL ORC MR 3144 3186 58 3.3 299.9 3.1X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 7054 7059 7 1.5 672.8 1.0X
SQL Json 8367 8370 3 1.3 798.0 0.8X
SQL Parquet Vectorized: DataPageV1 1085 1124 54 9.7 103.5 6.5X
SQL Parquet Vectorized: DataPageV2 1454 1458 7 7.2 138.6 4.9X
SQL Parquet MR: DataPageV1 3428 3429 0 3.1 326.9 2.1X
SQL Parquet MR: DataPageV2 3487 3489 3 3.0 332.6 2.0X
ParquetReader Vectorized: DataPageV1 1034 1071 53 10.1 98.6 6.8X
ParquetReader Vectorized: DataPageV2 1391 1392 1 7.5 132.7 5.1X
SQL ORC Vectorized 1271 1284 18 8.3 121.2 5.6X
SQL ORC MR 2987 2992 8 3.5 284.8 2.4X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 5058 5063 8 2.1 482.4 1.0X
SQL Json 5026 5028 2 2.1 479.4 1.0X
SQL Parquet Vectorized: DataPageV1 258 266 9 40.7 24.6 19.6X
SQL Parquet Vectorized: DataPageV2 325 335 13 32.2 31.0 15.6X
SQL Parquet MR: DataPageV1 2247 2254 9 4.7 214.3 2.3X
SQL Parquet MR: DataPageV2 2110 2111 1 5.0 201.3 2.4X
ParquetReader Vectorized: DataPageV1 271 274 2 38.7 25.9 18.7X
ParquetReader Vectorized: DataPageV2 333 342 10 31.5 31.8 15.2X
SQL ORC Vectorized 399 433 37 26.3 38.1 12.7X
SQL ORC MR 1567 1569 3 6.7 149.4 3.2X
================================================================================================
Single Column Scan From Wide Columns
================================================================================================
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Single Column Scan from 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 2249 2253 6 0.5 2144.6 1.0X
SQL Json 2948 2948 1 0.4 2811.3 0.8X
SQL Parquet Vectorized: DataPageV1 43 65 19 24.4 41.0 52.3X
SQL Parquet Vectorized: DataPageV2 58 73 22 18.1 55.4 38.7X
SQL Parquet MR: DataPageV1 219 229 16 4.8 209.2 10.2X
SQL Parquet MR: DataPageV2 209 218 18 5.0 199.6 10.7X
SQL ORC Vectorized 53 69 18 19.8 50.5 42.5X
SQL ORC MR 168 192 40 6.3 159.9 13.4X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Single Column Scan from 50 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 5469 5474 6 0.2 5215.9 1.0X
SQL Json 11605 11659 76 0.1 11067.1 0.5X
SQL Parquet Vectorized: DataPageV1 62 91 25 17.0 58.9 88.6X
SQL Parquet Vectorized: DataPageV2 73 88 20 14.3 69.7 74.8X
SQL Parquet MR: DataPageV1 238 264 30 4.4 226.7 23.0X
SQL Parquet MR: DataPageV2 226 250 36 4.6 215.2 24.2X
SQL ORC Vectorized 71 102 31 14.8 67.5 77.3X
SQL ORC MR 184 205 27 5.7 175.1 29.8X
OpenJDK 64-Bit Server VM 11.0.18+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
SQL CSV 9824 9826 3 0.1 9369.2 1.0X
SQL Json 22808 23082 387 0.0 21751.8 0.4X
SQL Parquet Vectorized: DataPageV1 93 131 32 11.3 88.3 106.1X
SQL Parquet Vectorized: DataPageV2 103 127 22 10.2 98.3 95.3X
SQL Parquet MR: DataPageV1 270 298 28 3.9 257.9 36.3X
SQL Parquet MR: DataPageV2 256 299 34 4.1 243.8 38.4X
SQL ORC Vectorized 87 121 37 12.1 82.9 113.0X
SQL ORC MR 202 225 29 5.2 192.8 48.6X