/
FilterPushdownBenchmark-results.txt
670 lines (584 loc) · 64.9 KB
/
FilterPushdownBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
================================================================================================
Pushdown for many distinct value case
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9499 10037 469 1.7 604.0 1.0X
Parquet Vectorized (Pushdown) 566 599 27 27.8 36.0 16.8X
Native ORC Vectorized 5896 6268 681 2.7 374.9 1.6X
Native ORC Vectorized (Pushdown) 485 514 45 32.4 30.9 19.6X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9517 9895 388 1.7 605.1 1.0X
Parquet Vectorized (Pushdown) 557 564 10 28.2 35.4 17.1X
Native ORC Vectorized 6033 6181 148 2.6 383.5 1.6X
Native ORC Vectorized (Pushdown) 486 522 67 32.4 30.9 19.6X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9513 9666 229 1.7 604.8 1.0X
Parquet Vectorized (Pushdown) 542 548 9 29.0 34.4 17.6X
Native ORC Vectorized 6025 6052 46 2.6 383.1 1.6X
Native ORC Vectorized (Pushdown) 480 516 45 32.8 30.5 19.8X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9561 10010 371 1.6 607.9 1.0X
Parquet Vectorized (Pushdown) 538 554 22 29.3 34.2 17.8X
Native ORC Vectorized 6000 6018 12 2.6 381.5 1.6X
Native ORC Vectorized (Pushdown) 457 511 89 34.4 29.1 20.9X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10562 10599 57 1.5 671.5 1.0X
Parquet Vectorized (Pushdown) 599 604 8 26.2 38.1 17.6X
Native ORC Vectorized 6688 6699 11 2.4 425.2 1.6X
Native ORC Vectorized (Pushdown) 506 531 43 31.1 32.2 20.9X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 16187 17047 789 1.0 1029.1 1.0X
Parquet Vectorized (Pushdown) 16433 17381 706 1.0 1044.8 1.0X
Native ORC Vectorized 13257 13654 359 1.2 842.8 1.2X
Native ORC Vectorized (Pushdown) 14426 14451 25 1.1 917.2 1.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9767 10587 NaN 1.6 621.0 1.0X
Parquet Vectorized (Pushdown) 582 595 13 27.0 37.0 16.8X
Native ORC Vectorized 6064 6938 NaN 2.6 385.5 1.6X
Native ORC Vectorized (Pushdown) 477 527 94 33.0 30.3 20.5X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9777 9840 90 1.6 621.6 1.0X
Parquet Vectorized (Pushdown) 543 555 8 29.0 34.5 18.0X
Native ORC Vectorized 5640 5839 192 2.8 358.6 1.7X
Native ORC Vectorized (Pushdown) 443 497 46 35.5 28.2 22.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9249 9550 267 1.7 588.1 1.0X
Parquet Vectorized (Pushdown) 546 575 21 28.8 34.7 16.9X
Native ORC Vectorized 6139 6151 14 2.6 390.3 1.5X
Native ORC Vectorized (Pushdown) 481 515 60 32.7 30.6 19.2X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9830 9845 16 1.6 625.0 1.0X
Parquet Vectorized (Pushdown) 590 598 11 26.7 37.5 16.7X
Native ORC Vectorized 5649 5980 235 2.8 359.2 1.7X
Native ORC Vectorized (Pushdown) 456 482 39 34.5 29.0 21.6X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9078 9325 311 1.7 577.1 1.0X
Parquet Vectorized (Pushdown) 547 572 18 28.8 34.8 16.6X
Native ORC Vectorized 5546 5708 147 2.8 352.6 1.6X
Native ORC Vectorized (Pushdown) 455 484 46 34.6 28.9 19.9X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9206 9384 204 1.7 585.3 1.0X
Parquet Vectorized (Pushdown) 528 558 23 29.8 33.6 17.4X
Native ORC Vectorized 5621 5882 203 2.8 357.4 1.6X
Native ORC Vectorized (Pushdown) 449 479 39 35.1 28.5 20.5X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9965 10292 411 1.6 633.5 1.0X
Parquet Vectorized (Pushdown) 2037 2051 20 7.7 129.5 4.9X
Native ORC Vectorized 6269 6487 136 2.5 398.5 1.6X
Native ORC Vectorized (Pushdown) 1655 1773 72 9.5 105.2 6.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12160 12600 555 1.3 773.1 1.0X
Parquet Vectorized (Pushdown) 8595 8616 19 1.8 546.5 1.4X
Native ORC Vectorized 8865 9334 371 1.8 563.6 1.4X
Native ORC Vectorized (Pushdown) 6136 6413 321 2.6 390.1 2.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% int rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 14104 14196 90 1.1 896.7 1.0X
Parquet Vectorized (Pushdown) 13521 13952 323 1.2 859.7 1.0X
Native ORC Vectorized 10906 11180 186 1.4 693.4 1.3X
Native ORC Vectorized (Pushdown) 10520 10666 154 1.5 668.9 1.3X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 14663 14693 32 1.1 932.3 1.0X
Parquet Vectorized (Pushdown) 14728 15066 337 1.1 936.4 1.0X
Native ORC Vectorized 11440 11517 97 1.4 727.4 1.3X
Native ORC Vectorized (Pushdown) 11829 12152 456 1.3 752.1 1.2X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value > -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 14630 15599 880 1.1 930.1 1.0X
Parquet Vectorized (Pushdown) 14783 15969 750 1.1 939.9 1.0X
Native ORC Vectorized 11421 11737 393 1.4 726.1 1.3X
Native ORC Vectorized (Pushdown) 11907 12128 227 1.3 757.0 1.2X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value != -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 14663 14882 187 1.1 932.3 1.0X
Parquet Vectorized (Pushdown) 14715 14847 194 1.1 935.6 1.0X
Native ORC Vectorized 11489 11771 382 1.4 730.4 1.3X
Native ORC Vectorized (Pushdown) 11654 12357 520 1.3 741.0 1.3X
================================================================================================
Pushdown for few distinct value case (use dictionary encoding)
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 distinct string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8498 9089 859 1.9 540.3 1.0X
Parquet Vectorized (Pushdown) 451 459 13 34.9 28.6 18.9X
Native ORC Vectorized 7291 8145 1364 2.2 463.6 1.2X
Native ORC Vectorized (Pushdown) 791 846 48 19.9 50.3 10.7X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 distinct string row ('100' < value < '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8628 9099 464 1.8 548.6 1.0X
Parquet Vectorized (Pushdown) 459 466 13 34.3 29.2 18.8X
Native ORC Vectorized 7550 7583 29 2.1 480.0 1.1X
Native ORC Vectorized (Pushdown) 795 847 64 19.8 50.5 10.9X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row (value = '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8536 8981 518 1.8 542.7 1.0X
Parquet Vectorized (Pushdown) 522 538 22 30.2 33.2 16.4X
Native ORC Vectorized 7465 7683 150 2.1 474.6 1.1X
Native ORC Vectorized (Pushdown) 839 878 43 18.8 53.3 10.2X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row (value <=> '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8550 8645 174 1.8 543.6 1.0X
Parquet Vectorized (Pushdown) 573 584 13 27.4 36.5 14.9X
Native ORC Vectorized 7462 7597 140 2.1 474.4 1.1X
Native ORC Vectorized (Pushdown) 840 879 48 18.7 53.4 10.2X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row ('100' <= value <= '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8629 8650 28 1.8 548.6 1.0X
Parquet Vectorized (Pushdown) 525 535 18 30.0 33.4 16.4X
Native ORC Vectorized 7566 7582 14 2.1 481.1 1.1X
Native ORC Vectorized (Pushdown) 857 915 42 18.4 54.5 10.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all distinct string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 15889 16022 138 1.0 1010.2 1.0X
Parquet Vectorized (Pushdown) 15884 16311 734 1.0 1009.9 1.0X
Native ORC Vectorized 14848 15438 539 1.1 944.0 1.1X
Native ORC Vectorized (Pushdown) 15190 15703 469 1.0 965.8 1.0X
================================================================================================
Pushdown benchmark for StringStartsWith
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9773 11133 NaN 1.6 621.3 1.0X
Parquet Vectorized (Pushdown) 1334 1358 16 11.8 84.8 7.3X
Native ORC Vectorized 6201 7146 NaN 2.5 394.3 1.6X
Native ORC Vectorized (Pushdown) 6370 6645 286 2.5 405.0 1.5X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9572 9809 412 1.6 608.6 1.0X
Parquet Vectorized (Pushdown) 532 538 10 29.6 33.8 18.0X
Native ORC Vectorized 6028 6271 327 2.6 383.3 1.6X
Native ORC Vectorized (Pushdown) 6184 6195 7 2.5 393.2 1.5X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9657 9803 166 1.6 614.0 1.0X
Parquet Vectorized (Pushdown) 522 529 12 30.1 33.2 18.5X
Native ORC Vectorized 6011 6090 119 2.6 382.2 1.6X
Native ORC Vectorized (Pushdown) 6151 6303 186 2.6 391.1 1.6X
================================================================================================
Pushdown benchmark for decimal
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(9, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4389 4447 77 3.6 279.0 1.0X
Parquet Vectorized (Pushdown) 129 148 61 122.3 8.2 34.1X
Native ORC Vectorized 4122 4186 118 3.8 262.1 1.1X
Native ORC Vectorized (Pushdown) 151 166 21 104.0 9.6 29.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(9, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5680 5742 62 2.8 361.1 1.0X
Parquet Vectorized (Pushdown) 2315 2378 66 6.8 147.2 2.5X
Native ORC Vectorized 5436 5585 133 2.9 345.6 1.0X
Native ORC Vectorized (Pushdown) 2257 2434 120 7.0 143.5 2.5X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(9, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10410 10733 298 1.5 661.8 1.0X
Parquet Vectorized (Pushdown) 9512 9712 116 1.7 604.8 1.1X
Native ORC Vectorized 9719 9851 162 1.6 617.9 1.1X
Native ORC Vectorized (Pushdown) 9207 9576 416 1.7 585.4 1.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(9, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11060 11153 114 1.4 703.2 1.0X
Parquet Vectorized (Pushdown) 11086 11190 133 1.4 704.8 1.0X
Native ORC Vectorized 10758 11220 390 1.5 684.0 1.0X
Native ORC Vectorized (Pushdown) 10807 11063 394 1.5 687.1 1.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(18, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4536 4621 112 3.5 288.4 1.0X
Parquet Vectorized (Pushdown) 128 133 7 122.6 8.2 35.4X
Native ORC Vectorized 4118 4177 68 3.8 261.8 1.1X
Native ORC Vectorized (Pushdown) 149 167 51 105.3 9.5 30.4X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(18, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5311 5392 73 3.0 337.6 1.0X
Parquet Vectorized (Pushdown) 1252 1259 6 12.6 79.6 4.2X
Native ORC Vectorized 4799 4910 92 3.3 305.1 1.1X
Native ORC Vectorized (Pushdown) 1213 1226 11 13.0 77.1 4.4X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(18, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 7909 7987 69 2.0 502.9 1.0X
Parquet Vectorized (Pushdown) 5707 5740 60 2.8 362.8 1.4X
Native ORC Vectorized 7428 8066 375 2.1 472.3 1.1X
Native ORC Vectorized (Pushdown) 5460 5717 243 2.9 347.1 1.4X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(18, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10502 10735 344 1.5 667.7 1.0X
Parquet Vectorized (Pushdown) 10104 10465 472 1.6 642.4 1.0X
Native ORC Vectorized 10047 10065 22 1.6 638.8 1.0X
Native ORC Vectorized (Pushdown) 9703 10202 598 1.6 616.9 1.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(38, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 6375 6533 179 2.5 405.3 1.0X
Parquet Vectorized (Pushdown) 143 147 8 110.2 9.1 44.7X
Native ORC Vectorized 4147 4250 113 3.8 263.7 1.5X
Native ORC Vectorized (Pushdown) 148 161 22 106.0 9.4 43.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(38, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 7198 7404 221 2.2 457.6 1.0X
Parquet Vectorized (Pushdown) 1587 1623 60 9.9 100.9 4.5X
Native ORC Vectorized 4965 5262 210 3.2 315.7 1.4X
Native ORC Vectorized (Pushdown) 1340 1343 2 11.7 85.2 5.4X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(38, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10470 10606 145 1.5 665.7 1.0X
Parquet Vectorized (Pushdown) 7345 7527 163 2.1 467.0 1.4X
Native ORC Vectorized 8031 8335 300 2.0 510.6 1.3X
Native ORC Vectorized (Pushdown) 6053 6503 264 2.6 384.8 1.7X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(38, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 13811 14052 150 1.1 878.1 1.0X
Parquet Vectorized (Pushdown) 13021 13248 169 1.2 827.9 1.1X
Native ORC Vectorized 11062 11206 195 1.4 703.3 1.2X
Native ORC Vectorized (Pushdown) 10704 11068 342 1.5 680.6 1.3X
================================================================================================
Pushdown benchmark for InSet -> InFilters
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8892 9754 603 1.8 565.4 1.0X
Parquet Vectorized (Pushdown) 544 571 31 28.9 34.6 16.3X
Native ORC Vectorized 5535 6737 NaN 2.8 351.9 1.6X
Native ORC Vectorized (Pushdown) 449 463 30 35.1 28.5 19.8X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8820 9522 845 1.8 560.8 1.0X
Parquet Vectorized (Pushdown) 539 562 28 29.2 34.3 16.4X
Native ORC Vectorized 5576 5838 249 2.8 354.5 1.6X
Native ORC Vectorized (Pushdown) 442 462 41 35.6 28.1 20.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8812 8896 104 1.8 560.3 1.0X
Parquet Vectorized (Pushdown) 544 552 6 28.9 34.6 16.2X
Native ORC Vectorized 5428 5746 297 2.9 345.1 1.6X
Native ORC Vectorized (Pushdown) 439 461 36 35.8 27.9 20.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8842 9189 472 1.8 562.2 1.0X
Parquet Vectorized (Pushdown) 560 607 41 28.1 35.6 15.8X
Native ORC Vectorized 5473 5526 99 2.9 347.9 1.6X
Native ORC Vectorized (Pushdown) 463 497 31 34.0 29.5 19.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8803 8961 215 1.8 559.7 1.0X
Parquet Vectorized (Pushdown) 569 572 5 27.7 36.2 15.5X
Native ORC Vectorized 5459 5497 25 2.9 347.1 1.6X
Native ORC Vectorized (Pushdown) 463 514 47 34.0 29.5 19.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8845 8940 78 1.8 562.4 1.0X
Parquet Vectorized (Pushdown) 566 570 7 27.8 36.0 15.6X
Native ORC Vectorized 5457 5503 75 2.9 346.9 1.6X
Native ORC Vectorized (Pushdown) 456 476 36 34.5 29.0 19.4X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9049 9202 229 1.7 575.3 1.0X
Parquet Vectorized (Pushdown) 1326 1342 12 11.9 84.3 6.8X
Native ORC Vectorized 5702 5712 5 2.8 362.5 1.6X
Native ORC Vectorized (Pushdown) 571 600 34 27.5 36.3 15.8X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9123 9301 165 1.7 580.1 1.0X
Parquet Vectorized (Pushdown) 4532 4550 31 3.5 288.1 2.0X
Native ORC Vectorized 5705 6067 310 2.8 362.7 1.6X
Native ORC Vectorized (Pushdown) 595 612 33 26.5 37.8 15.3X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9068 9215 208 1.7 576.5 1.0X
Parquet Vectorized (Pushdown) 8398 8731 294 1.9 534.0 1.1X
Native ORC Vectorized 5710 5788 153 2.8 363.1 1.6X
Native ORC Vectorized (Pushdown) 594 611 33 26.5 37.7 15.3X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9088 9527 330 1.7 577.8 1.0X
Parquet Vectorized (Pushdown) 1377 1498 79 11.4 87.6 6.6X
Native ORC Vectorized 5671 5735 97 2.8 360.5 1.6X
Native ORC Vectorized (Pushdown) 695 735 56 22.6 44.2 13.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9024 9105 78 1.7 573.7 1.0X
Parquet Vectorized (Pushdown) 4758 4841 108 3.3 302.5 1.9X
Native ORC Vectorized 5688 5697 8 2.8 361.6 1.6X
Native ORC Vectorized (Pushdown) 755 781 32 20.8 48.0 12.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9013 9252 144 1.7 573.0 1.0X
Parquet Vectorized (Pushdown) 8163 8615 353 1.9 519.0 1.1X
Native ORC Vectorized 5652 5848 284 2.8 359.4 1.6X
Native ORC Vectorized (Pushdown) 756 781 31 20.8 48.1 11.9X
================================================================================================
Pushdown benchmark for tinyint
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 tinyint row (value = CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4711 4726 17 3.3 299.5 1.0X
Parquet Vectorized (Pushdown) 176 181 5 89.3 11.2 26.8X
Native ORC Vectorized 2398 2423 32 6.6 152.4 2.0X
Native ORC Vectorized (Pushdown) 194 204 22 81.0 12.3 24.3X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% tinyint rows (value < CAST(12 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5404 5688 240 2.9 343.6 1.0X
Parquet Vectorized (Pushdown) 1170 1172 2 13.4 74.4 4.6X
Native ORC Vectorized 2989 3124 178 5.3 190.1 1.8X
Native ORC Vectorized (Pushdown) 951 1055 59 16.5 60.5 5.7X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% tinyint rows (value < CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 7750 7858 139 2.0 492.7 1.0X
Parquet Vectorized (Pushdown) 5563 5758 210 2.8 353.7 1.4X
Native ORC Vectorized 5237 5392 175 3.0 333.0 1.5X
Native ORC Vectorized (Pushdown) 4153 4370 224 3.8 264.1 1.9X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% tinyint rows (value < CAST(114 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10157 10296 245 1.5 645.7 1.0X
Parquet Vectorized (Pushdown) 9724 9765 62 1.6 618.2 1.0X
Native ORC Vectorized 7529 7758 201 2.1 478.7 1.3X
Native ORC Vectorized (Pushdown) 7354 7651 261 2.1 467.6 1.4X
================================================================================================
Pushdown benchmark for Timestamp
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as INT96 row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5300 5519 123 3.0 337.0 1.0X
Parquet Vectorized (Pushdown) 5041 5107 87 3.1 320.5 1.1X
Native ORC Vectorized 2322 2337 16 6.8 147.6 2.3X
Native ORC Vectorized (Pushdown) 122 135 23 128.7 7.8 43.4X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as INT96 rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5665 5777 107 2.8 360.2 1.0X
Parquet Vectorized (Pushdown) 5697 5752 69 2.8 362.2 1.0X
Native ORC Vectorized 2951 3028 116 5.3 187.6 1.9X
Native ORC Vectorized (Pushdown) 960 995 50 16.4 61.1 5.9X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as INT96 rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8205 8316 129 1.9 521.6 1.0X
Parquet Vectorized (Pushdown) 8239 8571 386 1.9 523.8 1.0X
Native ORC Vectorized 5361 5478 151 2.9 340.8 1.5X
Native ORC Vectorized (Pushdown) 4277 4313 69 3.7 271.9 1.9X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as INT96 rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10698 10865 224 1.5 680.2 1.0X
Parquet Vectorized (Pushdown) 10698 10814 164 1.5 680.2 1.0X
Native ORC Vectorized 7790 7912 131 2.0 495.3 1.4X
Native ORC Vectorized (Pushdown) 7600 7607 8 2.1 483.2 1.4X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as TIMESTAMP_MICROS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4478 4511 44 3.5 284.7 1.0X
Parquet Vectorized (Pushdown) 128 133 6 122.9 8.1 35.0X
Native ORC Vectorized 2320 2342 16 6.8 147.5 1.9X
Native ORC Vectorized (Pushdown) 122 128 18 129.4 7.7 36.8X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5208 5289 96 3.0 331.1 1.0X
Parquet Vectorized (Pushdown) 1203 1284 67 13.1 76.5 4.3X
Native ORC Vectorized 2931 2939 7 5.4 186.4 1.8X
Native ORC Vectorized (Pushdown) 952 985 49 16.5 60.5 5.5X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 7686 7841 135 2.0 488.7 1.0X
Parquet Vectorized (Pushdown) 5467 5556 142 2.9 347.6 1.4X
Native ORC Vectorized 5354 5367 14 2.9 340.4 1.4X
Native ORC Vectorized (Pushdown) 4264 4316 90 3.7 271.1 1.8X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10094 10203 112 1.6 641.7 1.0X
Parquet Vectorized (Pushdown) 9772 9902 142 1.6 621.3 1.0X
Native ORC Vectorized 7763 7812 38 2.0 493.6 1.3X
Native ORC Vectorized (Pushdown) 7607 7777 270 2.1 483.6 1.3X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4604 4619 10 3.4 292.7 1.0X
Parquet Vectorized (Pushdown) 130 133 6 121.4 8.2 35.5X
Native ORC Vectorized 2325 2498 122 6.8 147.8 2.0X
Native ORC Vectorized (Pushdown) 122 132 16 129.1 7.7 37.8X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5276 5437 121 3.0 335.5 1.0X
Parquet Vectorized (Pushdown) 1221 1252 54 12.9 77.7 4.3X
Native ORC Vectorized 2939 2944 7 5.4 186.8 1.8X
Native ORC Vectorized (Pushdown) 957 967 8 16.4 60.8 5.5X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 7807 7881 69 2.0 496.4 1.0X
Parquet Vectorized (Pushdown) 5580 5672 87 2.8 354.8 1.4X
Native ORC Vectorized 5358 5506 307 2.9 340.7 1.5X
Native ORC Vectorized (Pushdown) 4274 4305 51 3.7 271.7 1.8X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10249 10548 289 1.5 651.6 1.0X
Parquet Vectorized (Pushdown) 9818 9982 198 1.6 624.2 1.0X
Native ORC Vectorized 7796 7829 46 2.0 495.6 1.3X
Native ORC Vectorized (Pushdown) 7605 7830 430 2.1 483.5 1.3X
================================================================================================
Pushdown benchmark with many filters
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 1 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 144 147 4 0.0 144082565.0 1.0X
Parquet Vectorized (Pushdown) 145 150 6 0.0 145484576.0 1.0X
Native ORC Vectorized 137 146 9 0.0 136912936.0 1.1X
Native ORC Vectorized (Pushdown) 147 150 6 0.0 146818967.0 1.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 250 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 1192 1357 168 0.0 1192156841.0 1.0X
Parquet Vectorized (Pushdown) 1250 1272 17 0.0 1250170661.0 1.0X
Native ORC Vectorized 1186 1229 67 0.0 1185866228.0 1.0X
Native ORC Vectorized (Pushdown) 1198 1251 52 0.0 1197551125.0 1.0X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 500 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5619 6215 801 0.0 5618994367.0 1.0X
Parquet Vectorized (Pushdown) 5868 5948 50 0.0 5867908741.0 1.0X
Native ORC Vectorized 5570 5771 256 0.0 5570184446.0 1.0X
Native ORC Vectorized (Pushdown) 5574 5618 35 0.0 5573884681.0 1.0X