/
FilterPushdownBenchmark-jdk11-results.txt
670 lines (584 loc) · 64.9 KB
/
FilterPushdownBenchmark-jdk11-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
================================================================================================
Pushdown for many distinct value case
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11978 12017 26 1.3 761.6 1.0X
Parquet Vectorized (Pushdown) 548 561 15 28.7 34.8 21.9X
Native ORC Vectorized 8394 8447 42 1.9 533.7 1.4X
Native ORC Vectorized (Pushdown) 458 486 38 34.4 29.1 26.2X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12041 12057 13 1.3 765.6 1.0X
Parquet Vectorized (Pushdown) 534 545 10 29.4 34.0 22.5X
Native ORC Vectorized 8380 8429 33 1.9 532.8 1.4X
Native ORC Vectorized (Pushdown) 456 493 45 34.5 29.0 26.4X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12002 12064 64 1.3 763.1 1.0X
Parquet Vectorized (Pushdown) 516 531 13 30.5 32.8 23.2X
Native ORC Vectorized 8384 8428 36 1.9 533.1 1.4X
Native ORC Vectorized (Pushdown) 447 465 34 35.2 28.4 26.8X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12025 12119 100 1.3 764.5 1.0X
Parquet Vectorized (Pushdown) 517 523 7 30.4 32.9 23.2X
Native ORC Vectorized 8394 8417 19 1.9 533.7 1.4X
Native ORC Vectorized (Pushdown) 436 458 37 36.1 27.7 27.6X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12019 12089 42 1.3 764.2 1.0X
Parquet Vectorized (Pushdown) 512 522 10 30.7 32.5 23.5X
Native ORC Vectorized 8242 8379 82 1.9 524.0 1.5X
Native ORC Vectorized (Pushdown) 407 432 48 38.7 25.9 29.5X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 17734 17869 120 0.9 1127.5 1.0X
Parquet Vectorized (Pushdown) 17817 17904 65 0.9 1132.8 1.0X
Native ORC Vectorized 14365 14482 96 1.1 913.3 1.2X
Native ORC Vectorized (Pushdown) 14506 14573 59 1.1 922.2 1.2X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10223 10238 12 1.5 650.0 1.0X
Parquet Vectorized (Pushdown) 446 456 11 35.2 28.4 22.9X
Native ORC Vectorized 7526 7555 23 2.1 478.5 1.4X
Native ORC Vectorized (Pushdown) 379 394 28 41.5 24.1 27.0X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10198 10261 52 1.5 648.4 1.0X
Parquet Vectorized (Pushdown) 452 458 8 34.8 28.7 22.6X
Native ORC Vectorized 7556 7583 23 2.1 480.4 1.3X
Native ORC Vectorized (Pushdown) 382 401 32 41.2 24.3 26.7X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10242 10256 15 1.5 651.2 1.0X
Parquet Vectorized (Pushdown) 446 456 13 35.2 28.4 22.9X
Native ORC Vectorized 7569 7605 37 2.1 481.3 1.4X
Native ORC Vectorized (Pushdown) 381 395 28 41.3 24.2 26.9X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10289 10341 79 1.5 654.2 1.0X
Parquet Vectorized (Pushdown) 453 459 8 34.7 28.8 22.7X
Native ORC Vectorized 7620 7679 61 2.1 484.5 1.4X
Native ORC Vectorized (Pushdown) 386 413 37 40.8 24.5 26.7X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10651 10910 173 1.5 677.2 1.0X
Parquet Vectorized (Pushdown) 460 476 19 34.2 29.2 23.2X
Native ORC Vectorized 7756 7805 44 2.0 493.1 1.4X
Native ORC Vectorized (Pushdown) 386 407 32 40.8 24.5 27.6X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10516 10761 161 1.5 668.6 1.0X
Parquet Vectorized (Pushdown) 459 467 8 34.2 29.2 22.9X
Native ORC Vectorized 7742 7805 50 2.0 492.2 1.4X
Native ORC Vectorized (Pushdown) 388 416 34 40.5 24.7 27.1X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11294 11467 166 1.4 718.0 1.0X
Parquet Vectorized (Pushdown) 1926 2013 99 8.2 122.4 5.9X
Native ORC Vectorized 8199 8341 90 1.9 521.3 1.4X
Native ORC Vectorized (Pushdown) 1538 1579 43 10.2 97.8 7.3X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 13158 13769 374 1.2 836.6 1.0X
Parquet Vectorized (Pushdown) 7456 7895 394 2.1 474.0 1.8X
Native ORC Vectorized 10289 10486 111 1.5 654.2 1.3X
Native ORC Vectorized (Pushdown) 5875 6321 425 2.7 373.5 2.2X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% int rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 16075 16463 369 1.0 1022.0 1.0X
Parquet Vectorized (Pushdown) 15214 15393 158 1.0 967.3 1.1X
Native ORC Vectorized 12285 12458 197 1.3 781.0 1.3X
Native ORC Vectorized (Pushdown) 11734 12006 165 1.3 746.0 1.4X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 16620 17005 239 0.9 1056.7 1.0X
Parquet Vectorized (Pushdown) 17816 17853 50 0.9 1132.7 0.9X
Native ORC Vectorized 13880 13907 22 1.1 882.5 1.2X
Native ORC Vectorized (Pushdown) 14026 14136 155 1.1 891.8 1.2X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value > -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 17751 17796 27 0.9 1128.6 1.0X
Parquet Vectorized (Pushdown) 17794 17901 133 0.9 1131.3 1.0X
Native ORC Vectorized 14071 14093 17 1.1 894.6 1.3X
Native ORC Vectorized (Pushdown) 14248 14332 102 1.1 905.9 1.2X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value != -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 17711 17895 114 0.9 1126.0 1.0X
Parquet Vectorized (Pushdown) 17785 17851 64 0.9 1130.7 1.0X
Native ORC Vectorized 14090 14139 37 1.1 895.8 1.3X
Native ORC Vectorized (Pushdown) 14273 14323 57 1.1 907.4 1.2X
================================================================================================
Pushdown for few distinct value case (use dictionary encoding)
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 distinct string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9899 10087 164 1.6 629.4 1.0X
Parquet Vectorized (Pushdown) 391 410 19 40.3 24.8 25.3X
Native ORC Vectorized 9057 9360 192 1.7 575.8 1.1X
Native ORC Vectorized (Pushdown) 700 718 38 22.5 44.5 14.1X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 distinct string row ('100' < value < '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10025 10200 168 1.6 637.3 1.0X
Parquet Vectorized (Pushdown) 397 426 21 39.6 25.2 25.3X
Native ORC Vectorized 9121 9410 364 1.7 579.9 1.1X
Native ORC Vectorized (Pushdown) 735 785 55 21.4 46.7 13.6X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row (value = '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9735 10222 440 1.6 618.9 1.0X
Parquet Vectorized (Pushdown) 457 462 9 34.4 29.0 21.3X
Native ORC Vectorized 8807 8925 134 1.8 559.9 1.1X
Native ORC Vectorized (Pushdown) 752 785 41 20.9 47.8 12.9X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row (value <=> '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9696 9777 64 1.6 616.5 1.0X
Parquet Vectorized (Pushdown) 455 460 8 34.6 28.9 21.3X
Native ORC Vectorized 8756 9031 335 1.8 556.7 1.1X
Native ORC Vectorized (Pushdown) 752 772 32 20.9 47.8 12.9X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row ('100' <= value <= '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9832 9944 106 1.6 625.1 1.0X
Parquet Vectorized (Pushdown) 455 466 13 34.6 28.9 21.6X
Native ORC Vectorized 8827 9214 342 1.8 561.2 1.1X
Native ORC Vectorized (Pushdown) 758 789 39 20.7 48.2 13.0X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all distinct string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 17025 17087 72 0.9 1082.4 1.0X
Parquet Vectorized (Pushdown) 16927 17099 141 0.9 1076.2 1.0X
Native ORC Vectorized 15866 15916 61 1.0 1008.7 1.1X
Native ORC Vectorized (Pushdown) 16409 16804 366 1.0 1043.2 1.0X
================================================================================================
Pushdown benchmark for StringStartsWith
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11253 11348 87 1.4 715.5 1.0X
Parquet Vectorized (Pushdown) 1238 1356 70 12.7 78.7 9.1X
Native ORC Vectorized 8184 8291 88 1.9 520.3 1.4X
Native ORC Vectorized (Pushdown) 8403 8522 168 1.9 534.2 1.3X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11590 11827 190 1.4 736.8 1.0X
Parquet Vectorized (Pushdown) 513 517 7 30.7 32.6 22.6X
Native ORC Vectorized 8276 8444 190 1.9 526.2 1.4X
Native ORC Vectorized (Pushdown) 8509 8743 219 1.8 541.0 1.4X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12172 12213 25 1.3 773.9 1.0X
Parquet Vectorized (Pushdown) 508 513 10 31.0 32.3 24.0X
Native ORC Vectorized 8404 8524 161 1.9 534.3 1.4X
Native ORC Vectorized (Pushdown) 8511 8613 100 1.8 541.1 1.4X
================================================================================================
Pushdown benchmark for decimal
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(9, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4734 4827 66 3.3 301.0 1.0X
Parquet Vectorized (Pushdown) 124 130 13 127.2 7.9 38.3X
Native ORC Vectorized 4569 4634 68 3.4 290.5 1.0X
Native ORC Vectorized (Pushdown) 136 146 17 115.7 8.6 34.8X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(9, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 6332 6691 272 2.5 402.6 1.0X
Parquet Vectorized (Pushdown) 2310 2315 4 6.8 146.9 2.7X
Native ORC Vectorized 5778 5805 24 2.7 367.4 1.1X
Native ORC Vectorized (Pushdown) 2210 2218 8 7.1 140.5 2.9X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(9, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10735 10757 19 1.5 682.5 1.0X
Parquet Vectorized (Pushdown) 10079 10132 54 1.6 640.8 1.1X
Native ORC Vectorized 10178 10196 15 1.5 647.1 1.1X
Native ORC Vectorized (Pushdown) 9625 9880 304 1.6 612.0 1.1X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(9, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12010 12384 366 1.3 763.6 1.0X
Parquet Vectorized (Pushdown) 12332 12688 332 1.3 784.1 1.0X
Native ORC Vectorized 11795 12034 338 1.3 749.9 1.0X
Native ORC Vectorized (Pushdown) 11393 11519 93 1.4 724.3 1.1X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(18, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4846 5024 124 3.2 308.1 1.0X
Parquet Vectorized (Pushdown) 110 121 7 143.2 7.0 44.1X
Native ORC Vectorized 4504 4630 122 3.5 286.3 1.1X
Native ORC Vectorized (Pushdown) 132 146 17 119.1 8.4 36.7X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(18, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5708 5961 144 2.8 362.9 1.0X
Parquet Vectorized (Pushdown) 1174 1178 4 13.4 74.6 4.9X
Native ORC Vectorized 5093 5257 204 3.1 323.8 1.1X
Native ORC Vectorized (Pushdown) 1145 1188 67 13.7 72.8 5.0X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(18, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8151 8859 399 1.9 518.2 1.0X
Parquet Vectorized (Pushdown) 6430 6447 17 2.4 408.8 1.3X
Native ORC Vectorized 8536 8568 29 1.8 542.7 1.0X
Native ORC Vectorized (Pushdown) 6179 6207 25 2.5 392.9 1.3X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(18, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11947 11994 31 1.3 759.6 1.0X
Parquet Vectorized (Pushdown) 11440 11450 8 1.4 727.3 1.0X
Native ORC Vectorized 11432 11484 81 1.4 726.8 1.0X
Native ORC Vectorized (Pushdown) 11017 11047 27 1.4 700.5 1.1X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(38, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 6604 6736 211 2.4 419.9 1.0X
Parquet Vectorized (Pushdown) 122 135 9 128.7 7.8 54.0X
Native ORC Vectorized 4532 4632 71 3.5 288.2 1.5X
Native ORC Vectorized (Pushdown) 131 143 14 120.3 8.3 50.5X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(38, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8282 8335 57 1.9 526.6 1.0X
Parquet Vectorized (Pushdown) 1531 1682 85 10.3 97.3 5.4X
Native ORC Vectorized 5317 5457 150 3.0 338.0 1.6X
Native ORC Vectorized (Pushdown) 1304 1403 90 12.1 82.9 6.3X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(38, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11000 11344 271 1.4 699.3 1.0X
Parquet Vectorized (Pushdown) 7786 8102 215 2.0 495.0 1.4X
Native ORC Vectorized 9338 9364 20 1.7 593.7 1.2X
Native ORC Vectorized (Pushdown) 6998 7014 14 2.2 444.9 1.6X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(38, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 15559 15591 55 1.0 989.2 1.0X
Parquet Vectorized (Pushdown) 14830 14858 25 1.1 942.9 1.0X
Native ORC Vectorized 12854 12879 19 1.2 817.2 1.2X
Native ORC Vectorized (Pushdown) 12466 12518 69 1.3 792.6 1.2X
================================================================================================
Pushdown benchmark for InSet -> InFilters
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10835 10919 69 1.5 688.9 1.0X
Parquet Vectorized (Pushdown) 488 513 14 32.2 31.0 22.2X
Native ORC Vectorized 7877 7959 87 2.0 500.8 1.4X
Native ORC Vectorized (Pushdown) 390 419 30 40.3 24.8 27.8X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10547 10969 299 1.5 670.6 1.0X
Parquet Vectorized (Pushdown) 471 475 4 33.4 30.0 22.4X
Native ORC Vectorized 7795 7893 81 2.0 495.6 1.4X
Native ORC Vectorized (Pushdown) 440 458 34 35.7 28.0 24.0X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10535 10900 239 1.5 669.8 1.0X
Parquet Vectorized (Pushdown) 474 513 27 33.2 30.1 22.2X
Native ORC Vectorized 7860 7938 71 2.0 499.8 1.3X
Native ORC Vectorized (Pushdown) 430 464 43 36.5 27.4 24.5X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11237 11280 29 1.4 714.4 1.0X
Parquet Vectorized (Pushdown) 554 557 5 28.4 35.2 20.3X
Native ORC Vectorized 7937 8057 102 2.0 504.6 1.4X
Native ORC Vectorized (Pushdown) 453 472 36 34.7 28.8 24.8X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11205 11290 67 1.4 712.4 1.0X
Parquet Vectorized (Pushdown) 547 552 5 28.7 34.8 20.5X
Native ORC Vectorized 8068 8177 108 1.9 512.9 1.4X
Native ORC Vectorized (Pushdown) 461 477 30 34.1 29.3 24.3X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11283 11401 127 1.4 717.3 1.0X
Parquet Vectorized (Pushdown) 549 551 4 28.7 34.9 20.6X
Native ORC Vectorized 7976 8030 60 2.0 507.1 1.4X
Native ORC Vectorized (Pushdown) 459 475 29 34.2 29.2 24.6X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11552 11622 92 1.4 734.4 1.0X
Parquet Vectorized (Pushdown) 10502 11228 585 1.5 667.7 1.1X
Native ORC Vectorized 7839 7881 70 2.0 498.4 1.5X
Native ORC Vectorized (Pushdown) 529 555 33 29.7 33.7 21.8X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10515 10579 70 1.5 668.5 1.0X
Parquet Vectorized (Pushdown) 10915 11107 182 1.4 694.0 1.0X
Native ORC Vectorized 7967 8041 60 2.0 506.5 1.3X
Native ORC Vectorized (Pushdown) 569 617 38 27.6 36.2 18.5X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10813 10973 164 1.5 687.4 1.0X
Parquet Vectorized (Pushdown) 10886 11183 205 1.4 692.1 1.0X
Native ORC Vectorized 7923 8029 65 2.0 503.7 1.4X
Native ORC Vectorized (Pushdown) 553 565 21 28.5 35.1 19.6X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10793 10960 194 1.5 686.2 1.0X
Parquet Vectorized (Pushdown) 10717 10930 131 1.5 681.4 1.0X
Native ORC Vectorized 7963 8188 188 2.0 506.3 1.4X
Native ORC Vectorized (Pushdown) 634 655 28 24.8 40.3 17.0X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10464 10627 201 1.5 665.3 1.0X
Parquet Vectorized (Pushdown) 10594 10738 148 1.5 673.5 1.0X
Native ORC Vectorized 20350 20981 957 0.8 1293.8 0.5X
Native ORC Vectorized (Pushdown) 701 734 32 22.4 44.6 14.9X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 20944 21080 87 0.8 1331.6 1.0X
Parquet Vectorized (Pushdown) 20939 21078 95 0.8 1331.2 1.0X
Native ORC Vectorized 20297 20528 176 0.8 1290.5 1.0X
Native ORC Vectorized (Pushdown) 711 729 23 22.1 45.2 29.4X
================================================================================================
Pushdown benchmark for tinyint
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 tinyint row (value = CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5177 5464 186 3.0 329.1 1.0X
Parquet Vectorized (Pushdown) 173 176 4 90.8 11.0 29.9X
Native ORC Vectorized 3034 3121 56 5.2 192.9 1.7X
Native ORC Vectorized (Pushdown) 174 187 18 90.2 11.1 29.7X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% tinyint rows (value < CAST(12 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 6057 6210 109 2.6 385.1 1.0X
Parquet Vectorized (Pushdown) 1129 1195 49 13.9 71.8 5.4X
Native ORC Vectorized 3621 3725 91 4.3 230.2 1.7X
Native ORC Vectorized (Pushdown) 918 928 9 17.1 58.4 6.6X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% tinyint rows (value < CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8118 8391 303 1.9 516.1 1.0X
Parquet Vectorized (Pushdown) 5527 5823 221 2.8 351.4 1.5X
Native ORC Vectorized 6165 6299 76 2.6 392.0 1.3X
Native ORC Vectorized (Pushdown) 4844 4852 6 3.2 308.0 1.7X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% tinyint rows (value < CAST(114 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11575 11622 46 1.4 735.9 1.0X
Parquet Vectorized (Pushdown) 11218 11297 96 1.4 713.2 1.0X
Native ORC Vectorized 8864 8924 42 1.8 563.5 1.3X
Native ORC Vectorized (Pushdown) 8641 8697 39 1.8 549.4 1.3X
================================================================================================
Pushdown benchmark for Timestamp
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as INT96 row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5902 5932 22 2.7 375.3 1.0X
Parquet Vectorized (Pushdown) 5924 5930 6 2.7 376.6 1.0X
Native ORC Vectorized 2912 2939 21 5.4 185.2 2.0X
Native ORC Vectorized (Pushdown) 119 128 22 132.3 7.6 49.7X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as INT96 rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 6605 6636 30 2.4 419.9 1.0X
Parquet Vectorized (Pushdown) 6629 6641 19 2.4 421.4 1.0X
Native ORC Vectorized 3614 3623 9 4.4 229.8 1.8X
Native ORC Vectorized (Pushdown) 1035 1050 13 15.2 65.8 6.4X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as INT96 rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9477 9499 30 1.7 602.5 1.0X
Parquet Vectorized (Pushdown) 9457 9487 31 1.7 601.3 1.0X
Native ORC Vectorized 6263 6287 38 2.5 398.2 1.5X
Native ORC Vectorized (Pushdown) 4866 4881 12 3.2 309.4 1.9X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as INT96 rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12205 12248 44 1.3 776.0 1.0X
Parquet Vectorized (Pushdown) 12197 12251 36 1.3 775.5 1.0X
Native ORC Vectorized 7994 8292 365 2.0 508.3 1.5X
Native ORC Vectorized (Pushdown) 7830 7998 151 2.0 497.8 1.6X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as TIMESTAMP_MICROS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4826 5036 135 3.3 306.8 1.0X
Parquet Vectorized (Pushdown) 110 118 8 143.5 7.0 44.0X
Native ORC Vectorized 2658 2714 51 5.9 169.0 1.8X
Native ORC Vectorized (Pushdown) 106 118 12 148.9 6.7 45.7X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5652 5853 138 2.8 359.3 1.0X
Parquet Vectorized (Pushdown) 1141 1219 64 13.8 72.5 5.0X
Native ORC Vectorized 3267 3352 72 4.8 207.7 1.7X
Native ORC Vectorized (Pushdown) 916 922 8 17.2 58.2 6.2X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8150 8460 269 1.9 518.2 1.0X
Parquet Vectorized (Pushdown) 5913 6127 127 2.7 375.9 1.4X
Native ORC Vectorized 5604 5682 59 2.8 356.3 1.5X
Native ORC Vectorized (Pushdown) 4354 4461 120 3.6 276.8 1.9X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10445 10881 349 1.5 664.1 1.0X
Parquet Vectorized (Pushdown) 10488 10724 171 1.5 666.8 1.0X
Native ORC Vectorized 7960 8112 194 2.0 506.1 1.3X
Native ORC Vectorized (Pushdown) 7820 7993 213 2.0 497.2 1.3X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5244 5292 48 3.0 333.4 1.0X
Parquet Vectorized (Pushdown) 112 123 6 140.8 7.1 46.9X
Native ORC Vectorized 2699 2830 86 5.8 171.6 1.9X
Native ORC Vectorized (Pushdown) 107 117 16 146.6 6.8 48.9X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5685 5853 109 2.8 361.4 1.0X
Parquet Vectorized (Pushdown) 1166 1171 4 13.5 74.1 4.9X
Native ORC Vectorized 3302 3368 78 4.8 209.9 1.7X
Native ORC Vectorized (Pushdown) 1030 1038 8 15.3 65.5 5.5X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8143 8447 228 1.9 517.7 1.0X
Parquet Vectorized (Pushdown) 5975 6080 98 2.6 379.9 1.4X
Native ORC Vectorized 5793 5892 133 2.7 368.3 1.4X
Native ORC Vectorized (Pushdown) 4425 4480 49 3.6 281.3 1.8X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11191 11470 181 1.4 711.5 1.0X
Parquet Vectorized (Pushdown) 10497 10835 245 1.5 667.4 1.1X
Native ORC Vectorized 8003 8189 158 2.0 508.8 1.4X
Native ORC Vectorized (Pushdown) 7793 7978 153 2.0 495.4 1.4X
================================================================================================
Pushdown benchmark with many filters
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 1 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 140 147 8 0.0 139557497.0 1.0X
Parquet Vectorized (Pushdown) 139 142 4 0.0 139413395.0 1.0X
Native ORC Vectorized 126 128 5 0.0 125637490.0 1.1X
Native ORC Vectorized (Pushdown) 131 134 6 0.0 130504948.0 1.1X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 250 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 1830 1872 43 0.0 1829585043.0 1.0X
Parquet Vectorized (Pushdown) 1674 1791 107 0.0 1673633879.0 1.1X
Native ORC Vectorized 1603 1620 20 0.0 1603103723.0 1.1X
Native ORC Vectorized (Pushdown) 1809 1822 13 0.0 1808644213.0 1.0X
OpenJDK 64-Bit Server VM 1.8.0_292-b10 on Linux 5.4.0-1047-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 500 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10259 10421 150 0.0 10259316108.0 1.0X
Parquet Vectorized (Pushdown) 10150 10507 352 0.0 10149981377.0 1.0X
Native ORC Vectorized 10054 10416 280 0.0 10054419857.0 1.0X
Native ORC Vectorized (Pushdown) 9640 9693 47 0.0 9639569534.0 1.1X