/
FilterPushdownBenchmark-jdk11-results.txt
670 lines (584 loc) · 64.9 KB
/
FilterPushdownBenchmark-jdk11-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
================================================================================================
Pushdown for many distinct value case
================================================================================================
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10186 10256 54 1.5 647.6 1.0X
Parquet Vectorized (Pushdown) 535 560 34 29.4 34.0 19.0X
Native ORC Vectorized 6486 6673 117 2.4 412.4 1.6X
Native ORC Vectorized (Pushdown) 480 506 21 32.8 30.5 21.2X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 string row ('7864320' < value < '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10095 10247 133 1.6 641.8 1.0X
Parquet Vectorized (Pushdown) 510 523 9 30.9 32.4 19.8X
Native ORC Vectorized 6791 6863 60 2.3 431.8 1.5X
Native ORC Vectorized (Pushdown) 484 503 16 32.5 30.8 20.9X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row (value = '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10225 10335 76 1.5 650.1 1.0X
Parquet Vectorized (Pushdown) 485 499 13 32.4 30.9 21.1X
Native ORC Vectorized 6742 6865 78 2.3 428.6 1.5X
Native ORC Vectorized (Pushdown) 448 463 12 35.1 28.5 22.8X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row (value <=> '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10203 10289 60 1.5 648.7 1.0X
Parquet Vectorized (Pushdown) 476 501 21 33.0 30.3 21.4X
Native ORC Vectorized 6741 6826 76 2.3 428.6 1.5X
Native ORC Vectorized (Pushdown) 452 466 11 34.8 28.8 22.6X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 string row ('7864320' <= value <= '7864320'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10107 10374 331 1.6 642.6 1.0X
Parquet Vectorized (Pushdown) 513 519 8 30.6 32.6 19.7X
Native ORC Vectorized 7104 7140 30 2.2 451.6 1.4X
Native ORC Vectorized (Pushdown) 488 495 7 32.2 31.0 20.7X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 18712 18754 50 0.8 1189.7 1.0X
Parquet Vectorized (Pushdown) 18777 18807 27 0.8 1193.8 1.0X
Native ORC Vectorized 14848 14864 14 1.1 944.0 1.3X
Native ORC Vectorized (Pushdown) 14997 15025 24 1.0 953.5 1.2X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 int row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9957 9986 33 1.6 633.1 1.0X
Parquet Vectorized (Pushdown) 478 497 12 32.9 30.4 20.8X
Native ORC Vectorized 6295 6498 133 2.5 400.2 1.6X
Native ORC Vectorized (Pushdown) 461 479 26 34.1 29.3 21.6X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 int row (7864320 < value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9969 9980 12 1.6 633.8 1.0X
Parquet Vectorized (Pushdown) 496 507 8 31.7 31.5 20.1X
Native ORC Vectorized 6458 6474 17 2.4 410.6 1.5X
Native ORC Vectorized (Pushdown) 472 479 7 33.3 30.0 21.1X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9988 9996 10 1.6 635.0 1.0X
Parquet Vectorized (Pushdown) 500 507 7 31.5 31.8 20.0X
Native ORC Vectorized 6543 6572 49 2.4 416.0 1.5X
Native ORC Vectorized (Pushdown) 461 470 6 34.1 29.3 21.7X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (value <=> 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9757 9930 103 1.6 620.3 1.0X
Parquet Vectorized (Pushdown) 489 500 11 32.2 31.1 20.0X
Native ORC Vectorized 6541 6554 13 2.4 415.9 1.5X
Native ORC Vectorized (Pushdown) 456 467 9 34.5 29.0 21.4X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (7864320 <= value <= 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9993 10001 11 1.6 635.3 1.0X
Parquet Vectorized (Pushdown) 490 497 10 32.1 31.2 20.4X
Native ORC Vectorized 6517 6533 18 2.4 414.4 1.5X
Native ORC Vectorized (Pushdown) 462 470 8 34.0 29.4 21.6X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 int row (7864319 < value < 7864321): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9994 10045 97 1.6 635.4 1.0X
Parquet Vectorized (Pushdown) 491 498 9 32.1 31.2 20.4X
Native ORC Vectorized 6519 6523 5 2.4 414.5 1.5X
Native ORC Vectorized (Pushdown) 456 465 9 34.5 29.0 21.9X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% int rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10770 10782 16 1.5 684.7 1.0X
Parquet Vectorized (Pushdown) 2240 2257 19 7.0 142.4 4.8X
Native ORC Vectorized 7276 7308 23 2.2 462.6 1.5X
Native ORC Vectorized (Pushdown) 1847 1860 13 8.5 117.4 5.8X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% int rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 13568 13603 27 1.2 862.6 1.0X
Parquet Vectorized (Pushdown) 8867 8879 12 1.8 563.7 1.5X
Native ORC Vectorized 9967 10027 48 1.6 633.7 1.4X
Native ORC Vectorized (Pushdown) 7032 7044 10 2.2 447.1 1.9X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% int rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 16352 16370 14 1.0 1039.6 1.0X
Parquet Vectorized (Pushdown) 15084 15407 182 1.0 959.0 1.1X
Native ORC Vectorized 12589 12659 44 1.2 800.4 1.3X
Native ORC Vectorized (Pushdown) 12201 12219 22 1.3 775.7 1.3X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 16252 16890 365 1.0 1033.3 1.0X
Parquet Vectorized (Pushdown) 17121 17160 25 0.9 1088.5 0.9X
Native ORC Vectorized 13391 13412 18 1.2 851.4 1.2X
Native ORC Vectorized (Pushdown) 13571 13579 7 1.2 862.8 1.2X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value > -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 16992 17031 34 0.9 1080.3 1.0X
Parquet Vectorized (Pushdown) 17038 17082 47 0.9 1083.2 1.0X
Native ORC Vectorized 13368 13382 11 1.2 849.9 1.3X
Native ORC Vectorized (Pushdown) 13510 13516 4 1.2 858.9 1.3X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all int rows (value != -1): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 17029 17056 19 0.9 1082.7 1.0X
Parquet Vectorized (Pushdown) 17095 17104 6 0.9 1086.8 1.0X
Native ORC Vectorized 13393 13443 110 1.2 851.5 1.3X
Native ORC Vectorized (Pushdown) 13535 13544 8 1.2 860.5 1.3X
================================================================================================
Pushdown for few distinct value case (use dictionary encoding)
================================================================================================
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 distinct string row (value IS NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9385 9420 42 1.7 596.7 1.0X
Parquet Vectorized (Pushdown) 427 432 9 36.8 27.2 22.0X
Native ORC Vectorized 8012 8023 17 2.0 509.4 1.2X
Native ORC Vectorized (Pushdown) 838 847 9 18.8 53.3 11.2X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 0 distinct string row ('100' < value < '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9578 9588 6 1.6 609.0 1.0X
Parquet Vectorized (Pushdown) 430 434 8 36.6 27.3 22.3X
Native ORC Vectorized 8340 8345 5 1.9 530.2 1.1X
Native ORC Vectorized (Pushdown) 841 851 12 18.7 53.4 11.4X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row (value = '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9474 9490 17 1.7 602.4 1.0X
Parquet Vectorized (Pushdown) 501 515 14 31.4 31.9 18.9X
Native ORC Vectorized 8217 8224 4 1.9 522.5 1.2X
Native ORC Vectorized (Pushdown) 898 909 10 17.5 57.1 10.5X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row (value <=> '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9480 9485 8 1.7 602.7 1.0X
Parquet Vectorized (Pushdown) 497 508 15 31.6 31.6 19.1X
Native ORC Vectorized 8220 8230 8 1.9 522.6 1.2X
Native ORC Vectorized (Pushdown) 899 906 7 17.5 57.2 10.5X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 distinct string row ('100' <= value <= '100'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9445 9589 80 1.7 600.5 1.0X
Parquet Vectorized (Pushdown) 497 512 13 31.6 31.6 19.0X
Native ORC Vectorized 7970 8209 213 2.0 506.7 1.2X
Native ORC Vectorized (Pushdown) 819 895 43 19.2 52.1 11.5X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select all distinct string rows (value IS NOT NULL): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 18388 18680 166 0.9 1169.1 1.0X
Parquet Vectorized (Pushdown) 18832 18862 24 0.8 1197.3 1.0X
Native ORC Vectorized 17292 17310 15 0.9 1099.4 1.1X
Native ORC Vectorized (Pushdown) 17555 17568 8 0.9 1116.1 1.0X
================================================================================================
Pushdown benchmark for StringStartsWith
================================================================================================
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '10%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11164 11182 24 1.4 709.8 1.0X
Parquet Vectorized (Pushdown) 1477 1491 15 10.6 93.9 7.6X
Native ORC Vectorized 7596 7662 84 2.1 483.0 1.5X
Native ORC Vectorized (Pushdown) 7701 7729 17 2.0 489.6 1.4X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '1000%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10708 10849 118 1.5 680.8 1.0X
Parquet Vectorized (Pushdown) 493 503 12 31.9 31.4 21.7X
Native ORC Vectorized 7378 7397 26 2.1 469.1 1.5X
Native ORC Vectorized (Pushdown) 7529 7714 178 2.1 478.7 1.4X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
StringStartsWith filter: (value like '786432%'): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10897 10928 33 1.4 692.8 1.0X
Parquet Vectorized (Pushdown) 482 493 16 32.6 30.6 22.6X
Native ORC Vectorized 7331 7370 24 2.1 466.1 1.5X
Native ORC Vectorized (Pushdown) 7480 7521 24 2.1 475.6 1.5X
================================================================================================
Pushdown benchmark for decimal
================================================================================================
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(9, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5056 5065 10 3.1 321.4 1.0X
Parquet Vectorized (Pushdown) 120 127 8 130.8 7.6 42.0X
Native ORC Vectorized 4924 4964 28 3.2 313.0 1.0X
Native ORC Vectorized (Pushdown) 156 162 7 100.6 9.9 32.3X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(9, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 6470 6630 133 2.4 411.4 1.0X
Parquet Vectorized (Pushdown) 2711 2747 26 5.8 172.4 2.4X
Native ORC Vectorized 6423 6564 79 2.4 408.4 1.0X
Native ORC Vectorized (Pushdown) 2728 2755 21 5.8 173.5 2.4X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(9, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11987 12002 20 1.3 762.1 1.0X
Parquet Vectorized (Pushdown) 11382 11388 4 1.4 723.6 1.1X
Native ORC Vectorized 11936 11945 10 1.3 758.9 1.0X
Native ORC Vectorized (Pushdown) 11331 11358 18 1.4 720.4 1.1X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(9, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12613 13154 304 1.2 801.9 1.0X
Parquet Vectorized (Pushdown) 13321 13338 31 1.2 846.9 0.9X
Native ORC Vectorized 13205 13230 26 1.2 839.5 1.0X
Native ORC Vectorized (Pushdown) 13248 13260 9 1.2 842.3 1.0X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(18, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5270 5278 12 3.0 335.0 1.0X
Parquet Vectorized (Pushdown) 118 123 5 133.7 7.5 44.8X
Native ORC Vectorized 4961 4982 13 3.2 315.4 1.1X
Native ORC Vectorized (Pushdown) 151 158 8 104.3 9.6 34.9X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(18, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 6152 6207 95 2.6 391.1 1.0X
Parquet Vectorized (Pushdown) 1480 1499 19 10.6 94.1 4.2X
Native ORC Vectorized 5818 5828 7 2.7 369.9 1.1X
Native ORC Vectorized (Pushdown) 1476 1485 14 10.7 93.8 4.2X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(18, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9451 9456 3 1.7 600.8 1.0X
Parquet Vectorized (Pushdown) 6866 6884 17 2.3 436.5 1.4X
Native ORC Vectorized 9138 9147 10 1.7 581.0 1.0X
Native ORC Vectorized (Pushdown) 6747 6750 2 2.3 429.0 1.4X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(18, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 12671 12683 16 1.2 805.6 1.0X
Parquet Vectorized (Pushdown) 12202 12233 26 1.3 775.8 1.0X
Native ORC Vectorized 12372 12380 8 1.3 786.6 1.0X
Native ORC Vectorized (Pushdown) 11937 11946 6 1.3 758.9 1.1X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 decimal(38, 2) row (value = 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 6937 6952 28 2.3 441.1 1.0X
Parquet Vectorized (Pushdown) 133 137 6 118.2 8.5 52.1X
Native ORC Vectorized 5007 5028 14 3.1 318.3 1.4X
Native ORC Vectorized (Pushdown) 153 160 4 102.8 9.7 45.4X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% decimal(38, 2) rows (value < 1572864): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8020 8031 12 2.0 509.9 1.0X
Parquet Vectorized (Pushdown) 1841 1855 14 8.5 117.0 4.4X
Native ORC Vectorized 6017 6021 5 2.6 382.5 1.3X
Native ORC Vectorized (Pushdown) 1612 1622 16 9.8 102.5 5.0X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% decimal(38, 2) rows (value < 7864320): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11983 12027 38 1.3 761.9 1.0X
Parquet Vectorized (Pushdown) 8620 8641 21 1.8 548.1 1.4X
Native ORC Vectorized 9850 9866 15 1.6 626.3 1.2X
Native ORC Vectorized (Pushdown) 7436 7455 13 2.1 472.8 1.6X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% decimal(38, 2) rows (value < 14155776): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 16022 16050 34 1.0 1018.7 1.0X
Parquet Vectorized (Pushdown) 15341 15396 50 1.0 975.3 1.0X
Native ORC Vectorized 13550 13573 19 1.2 861.5 1.2X
Native ORC Vectorized (Pushdown) 13126 13141 16 1.2 834.5 1.2X
================================================================================================
Pushdown benchmark for InSet -> InFilters
================================================================================================
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9377 9833 259 1.7 596.2 1.0X
Parquet Vectorized (Pushdown) 461 494 31 34.1 29.3 20.3X
Native ORC Vectorized 6656 6686 23 2.4 423.2 1.4X
Native ORC Vectorized (Pushdown) 464 475 11 33.9 29.5 20.2X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9953 9965 8 1.6 632.8 1.0X
Parquet Vectorized (Pushdown) 507 515 9 31.0 32.2 19.6X
Native ORC Vectorized 6660 6697 29 2.4 423.4 1.5X
Native ORC Vectorized (Pushdown) 471 481 9 33.4 30.0 21.1X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 5, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9261 9685 323 1.7 588.8 1.0X
Parquet Vectorized (Pushdown) 507 516 11 31.0 32.2 18.3X
Native ORC Vectorized 6663 6696 29 2.4 423.6 1.4X
Native ORC Vectorized (Pushdown) 461 473 14 34.1 29.3 20.1X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9960 9967 6 1.6 633.2 1.0X
Parquet Vectorized (Pushdown) 535 540 8 29.4 34.0 18.6X
Native ORC Vectorized 6662 6700 28 2.4 423.6 1.5X
Native ORC Vectorized (Pushdown) 486 495 7 32.3 30.9 20.5X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9972 9991 24 1.6 634.0 1.0X
Parquet Vectorized (Pushdown) 532 538 11 29.6 33.8 18.7X
Native ORC Vectorized 6678 6719 58 2.4 424.6 1.5X
Native ORC Vectorized (Pushdown) 484 494 9 32.5 30.8 20.6X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 10, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9954 9961 4 1.6 632.9 1.0X
Parquet Vectorized (Pushdown) 534 541 8 29.4 34.0 18.6X
Native ORC Vectorized 6675 6699 22 2.4 424.4 1.5X
Native ORC Vectorized (Pushdown) 486 493 8 32.3 30.9 20.5X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10270 10284 15 1.5 652.9 1.0X
Parquet Vectorized (Pushdown) 1421 1437 16 11.1 90.4 7.2X
Native ORC Vectorized 6953 6981 22 2.3 442.1 1.5X
Native ORC Vectorized (Pushdown) 616 623 8 25.5 39.2 16.7X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10265 10275 8 1.5 652.6 1.0X
Parquet Vectorized (Pushdown) 5382 5432 90 2.9 342.2 1.9X
Native ORC Vectorized 6966 6994 24 2.3 442.9 1.5X
Native ORC Vectorized (Pushdown) 647 657 10 24.3 41.1 15.9X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 50, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10263 10281 21 1.5 652.5 1.0X
Parquet Vectorized (Pushdown) 9116 9121 4 1.7 579.6 1.1X
Native ORC Vectorized 6950 6992 30 2.3 441.9 1.5X
Native ORC Vectorized (Pushdown) 637 647 12 24.7 40.5 16.1X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 10): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10205 10209 3 1.5 648.8 1.0X
Parquet Vectorized (Pushdown) 1444 1456 15 10.9 91.8 7.1X
Native ORC Vectorized 6773 6781 9 2.3 430.6 1.5X
Native ORC Vectorized (Pushdown) 739 761 21 21.3 47.0 13.8X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 50): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10240 10245 5 1.5 651.0 1.0X
Parquet Vectorized (Pushdown) 5294 5298 4 3.0 336.6 1.9X
Native ORC Vectorized 6796 6807 11 2.3 432.1 1.5X
Native ORC Vectorized (Pushdown) 832 840 7 18.9 52.9 12.3X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
InSet -> InFilters (values count: 100, distribution: 90): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 9580 10091 293 1.6 609.1 1.0X
Parquet Vectorized (Pushdown) 8409 8623 175 1.9 534.6 1.1X
Native ORC Vectorized 6499 6583 79 2.4 413.2 1.5X
Native ORC Vectorized (Pushdown) 754 769 19 20.9 48.0 12.7X
================================================================================================
Pushdown benchmark for tinyint
================================================================================================
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 tinyint row (value = CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4987 5013 22 3.2 317.1 1.0X
Parquet Vectorized (Pushdown) 165 174 10 95.0 10.5 30.1X
Native ORC Vectorized 2866 2914 50 5.5 182.2 1.7X
Native ORC Vectorized (Pushdown) 189 196 6 83.4 12.0 26.4X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% tinyint rows (value < CAST(12 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5530 5598 62 2.8 351.6 1.0X
Parquet Vectorized (Pushdown) 1244 1270 19 12.6 79.1 4.4X
Native ORC Vectorized 3397 3451 66 4.6 216.0 1.6X
Native ORC Vectorized (Pushdown) 1035 1054 11 15.2 65.8 5.3X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% tinyint rows (value < CAST(63 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8227 8352 235 1.9 523.0 1.0X
Parquet Vectorized (Pushdown) 5856 5899 69 2.7 372.3 1.4X
Native ORC Vectorized 5889 5963 75 2.7 374.4 1.4X
Native ORC Vectorized (Pushdown) 4649 4705 115 3.4 295.6 1.8X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% tinyint rows (value < CAST(114 AS tinyint)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11491 11628 170 1.4 730.6 1.0X
Parquet Vectorized (Pushdown) 10960 11054 103 1.4 696.8 1.0X
Native ORC Vectorized 8667 8957 191 1.8 551.1 1.3X
Native ORC Vectorized (Pushdown) 8696 8898 169 1.8 552.9 1.3X
================================================================================================
Pushdown benchmark for Timestamp
================================================================================================
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as INT96 row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-----------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5069 5286 192 3.1 322.3 1.0X
Parquet Vectorized (Pushdown) 5023 5049 24 3.1 319.3 1.0X
Native ORC Vectorized 2764 2776 9 5.7 175.7 1.8X
Native ORC Vectorized (Pushdown) 115 123 8 136.5 7.3 44.0X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as INT96 rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5786 5839 53 2.7 367.8 1.0X
Parquet Vectorized (Pushdown) 5748 5791 39 2.7 365.4 1.0X
Native ORC Vectorized 3390 3445 41 4.6 215.5 1.7X
Native ORC Vectorized (Pushdown) 1059 1071 11 14.9 67.3 5.5X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as INT96 rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8491 8506 26 1.9 539.9 1.0X
Parquet Vectorized (Pushdown) 8531 8603 60 1.8 542.4 1.0X
Native ORC Vectorized 5896 5916 15 2.7 374.8 1.4X
Native ORC Vectorized (Pushdown) 4687 4693 5 3.4 298.0 1.8X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as INT96 rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
---------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 11150 11219 137 1.4 708.9 1.0X
Parquet Vectorized (Pushdown) 11134 11285 205 1.4 707.9 1.0X
Native ORC Vectorized 8481 8486 5 1.9 539.2 1.3X
Native ORC Vectorized (Pushdown) 8288 8364 95 1.9 526.9 1.3X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as TIMESTAMP_MICROS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4611 4645 47 3.4 293.2 1.0X
Parquet Vectorized (Pushdown) 105 110 8 150.0 6.7 44.0X
Native ORC Vectorized 2756 2770 20 5.7 175.2 1.7X
Native ORC Vectorized (Pushdown) 113 118 4 139.2 7.2 40.8X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5330 5373 47 3.0 338.9 1.0X
Parquet Vectorized (Pushdown) 1259 1299 41 12.5 80.1 4.2X
Native ORC Vectorized 3355 3420 56 4.7 213.3 1.6X
Native ORC Vectorized (Pushdown) 1048 1066 13 15.0 66.6 5.1X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8089 8113 22 1.9 514.3 1.0X
Parquet Vectorized (Pushdown) 5855 5867 21 2.7 372.2 1.4X
Native ORC Vectorized 6108 6170 60 2.6 388.3 1.3X
Native ORC Vectorized (Pushdown) 4680 4840 142 3.4 297.6 1.7X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as TIMESTAMP_MICROS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10769 10891 136 1.5 684.7 1.0X
Parquet Vectorized (Pushdown) 10632 10927 197 1.5 675.9 1.0X
Native ORC Vectorized 8470 8478 9 1.9 538.5 1.3X
Native ORC Vectorized (Pushdown) 8282 8376 181 1.9 526.5 1.3X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 timestamp stored as TIMESTAMP_MILLIS row (value = timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4687 4698 16 3.4 298.0 1.0X
Parquet Vectorized (Pushdown) 109 113 6 144.6 6.9 43.1X
Native ORC Vectorized 2790 2815 25 5.6 177.4 1.7X
Native ORC Vectorized (Pushdown) 115 121 6 136.5 7.3 40.7X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 10% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(1572864)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 5404 5511 127 2.9 343.6 1.0X
Parquet Vectorized (Pushdown) 1270 1297 37 12.4 80.7 4.3X
Native ORC Vectorized 3377 3390 24 4.7 214.7 1.6X
Native ORC Vectorized (Pushdown) 1044 1062 15 15.1 66.4 5.2X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 50% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(7864320)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 8178 8206 19 1.9 519.9 1.0X
Parquet Vectorized (Pushdown) 5906 5950 68 2.7 375.5 1.4X
Native ORC Vectorized 5941 5947 4 2.6 377.7 1.4X
Native ORC Vectorized (Pushdown) 4709 4863 137 3.3 299.4 1.7X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 90% timestamp stored as TIMESTAMP_MILLIS rows (value < timestamp_seconds(14155776)): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 10845 10990 186 1.5 689.5 1.0X
Parquet Vectorized (Pushdown) 10389 10462 95 1.5 660.5 1.0X
Native ORC Vectorized 8519 8603 98 1.8 541.6 1.3X
Native ORC Vectorized (Pushdown) 8282 8614 364 1.9 526.6 1.3X
================================================================================================
Pushdown benchmark with many filters
================================================================================================
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 1 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 138 145 5 0.0 138200641.0 1.0X
Parquet Vectorized (Pushdown) 140 144 5 0.0 139707662.0 1.0X
Native ORC Vectorized 131 138 8 0.0 131372886.0 1.1X
Native ORC Vectorized (Pushdown) 144 149 6 0.0 143656253.0 1.0X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 250 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 1137 1232 116 0.0 1136609841.0 1.0X
Parquet Vectorized (Pushdown) 1170 1264 133 0.0 1169618222.0 1.0X
Native ORC Vectorized 1123 1180 33 0.0 1123340981.0 1.0X
Native ORC Vectorized (Pushdown) 1190 1266 66 0.0 1189906517.0 1.0X
OpenJDK 64-Bit Server VM 11.0.13+8-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Select 1 row with 500 filters: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Parquet Vectorized 4961 5176 243 0.0 4961396618.0 1.0X
Parquet Vectorized (Pushdown) 5147 5361 268 0.0 5147120588.0 1.0X
Native ORC Vectorized 4905 5136 241 0.0 4904836724.0 1.0X
Native ORC Vectorized (Pushdown) 4956 5390 399 0.0 4956323496.0 1.0X