-
Notifications
You must be signed in to change notification settings - Fork 28k
/
OrcReadBenchmark-results.txt
156 lines (129 loc) · 12.5 KB
/
OrcReadBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
================================================================================================
SQL Single Numeric Column Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single TINYINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 897 922 25 17.5 57.0 1.0X
Native ORC Vectorized 117 128 13 134.6 7.4 7.7X
Hive built-in ORC 1328 1332 6 11.8 84.4 0.7X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single SMALLINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 1003 1010 10 15.7 63.8 1.0X
Native ORC Vectorized 148 168 34 106.0 9.4 6.8X
Hive built-in ORC 1348 1364 23 11.7 85.7 0.7X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single INT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 1043 1047 6 15.1 66.3 1.0X
Native ORC Vectorized 168 174 10 93.8 10.7 6.2X
Hive built-in ORC 1398 1440 60 11.3 88.9 0.7X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single BIGINT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 1114 1182 96 14.1 70.8 1.0X
Native ORC Vectorized 249 259 17 63.3 15.8 4.5X
Hive built-in ORC 1533 1682 210 10.3 97.5 0.7X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single FLOAT Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 1120 1127 10 14.0 71.2 1.0X
Native ORC Vectorized 228 232 4 69.1 14.5 4.9X
Hive built-in ORC 1474 1481 9 10.7 93.7 0.8X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
SQL Single DOUBLE Column Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 1177 1206 42 13.4 74.8 1.0X
Native ORC Vectorized 270 295 47 58.3 17.2 4.4X
Hive built-in ORC 1500 1504 6 10.5 95.4 0.8X
================================================================================================
Int and String Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Int and String Scan: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 2174 2184 14 4.8 207.3 1.0X
Native ORC Vectorized 1179 1195 22 8.9 112.4 1.8X
Hive built-in ORC 2639 2669 43 4.0 251.7 0.8X
================================================================================================
Partitioned Table Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Partitioned Table: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Data column - Native ORC MR 1502 1510 11 10.5 95.5 1.0X
Data column - Native ORC Vectorized 256 292 50 61.4 16.3 5.9X
Data column - Hive built-in ORC 1783 1793 15 8.8 113.3 0.8X
Partition column - Native ORC MR 968 979 11 16.2 61.6 1.6X
Partition column - Native ORC Vectorized 46 52 16 340.2 2.9 32.5X
Partition column - Hive built-in ORC 1370 1375 6 11.5 87.1 1.1X
Both columns - Native ORC MR 1516 1525 13 10.4 96.4 1.0X
Both columns - Native ORC Vectorized 288 298 10 54.6 18.3 5.2X
Both columns - Hive built-in ORC 1796 1827 44 8.8 114.2 0.8X
================================================================================================
Repeated String Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Repeated String: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 1035 1057 32 10.1 98.7 1.0X
Native ORC Vectorized 197 200 2 53.3 18.8 5.3X
Hive built-in ORC 1435 1453 25 7.3 136.9 0.7X
================================================================================================
String with Nulls Scan
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
String with Nulls Scan (0.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 1905 1927 31 5.5 181.7 1.0X
Native ORC Vectorized 563 645 80 18.6 53.7 3.4X
Hive built-in ORC 2469 2477 11 4.2 235.5 0.8X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
String with Nulls Scan (50.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 1733 1743 14 6.1 165.3 1.0X
Native ORC Vectorized 636 667 39 16.5 60.6 2.7X
Hive built-in ORC 2201 2267 93 4.8 209.9 0.8X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
String with Nulls Scan (95.0%): Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 966 1052 134 10.9 92.1 1.0X
Native ORC Vectorized 241 247 6 43.4 23.0 4.0X
Hive built-in ORC 1285 1287 3 8.2 122.5 0.8X
================================================================================================
Single Column Scan From Wide Columns
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Single Column Scan from 100 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 124 134 17 8.5 118.3 1.0X
Native ORC Vectorized 64 71 12 16.5 60.8 1.9X
Hive built-in ORC 1037 1043 9 1.0 988.9 0.1X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Single Column Scan from 200 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 143 154 16 7.3 136.6 1.0X
Native ORC Vectorized 85 92 13 12.4 80.7 1.7X
Hive built-in ORC 1987 1997 15 0.5 1894.5 0.1X
OpenJDK 64-Bit Server VM 1.8.0_282-b08 on Linux 5.4.0-1043-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Single Column Scan from 300 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Native ORC MR 167 190 23 6.3 159.3 1.0X
Native ORC Vectorized 105 117 14 10.0 99.7 1.6X
Hive built-in ORC 2976 2985 13 0.4 2837.8 0.1X