-
Notifications
You must be signed in to change notification settings - Fork 28k
/
AggregateBenchmark-results.txt
148 lines (117 loc) · 11 KB
/
AggregateBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
================================================================================================
aggregate without grouping
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
agg w/o group: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
agg w/o group wholestage off 49148 52261 964 42.7 23.4 1.0X
agg w/o group wholestage on 1131 1163 21 1853.8 0.5 43.4X
================================================================================================
stat functions
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
stddev: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
stddev wholestage off 9131 10048 1297 11.5 87.1 1.0X
stddev wholestage on 1359 1375 16 77.2 13.0 6.7X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
kurtosis: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
kurtosis wholestage off 38233 38247 19 2.7 364.6 1.0X
kurtosis wholestage on 1447 1459 7 72.5 13.8 26.4X
================================================================================================
aggregate with linear keys
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 9795 9865 98 8.6 116.8 1.0X
codegen = T, hashmap = F 5823 6031 180 14.4 69.4 1.7X
codegen = T, row-based hashmap = T 2087 2139 80 40.2 24.9 4.7X
codegen = T, vectorized hashmap = T 1220 1374 138 68.8 14.5 8.0X
================================================================================================
aggregate with randomized keys
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Aggregate w keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 11629 11981 498 7.2 138.6 1.0X
codegen = T, hashmap = F 7601 7623 23 11.0 90.6 1.5X
codegen = T, row-based hashmap = T 3411 3470 88 24.6 40.7 3.4X
codegen = T, vectorized hashmap = T 2353 2493 104 35.6 28.1 4.9X
================================================================================================
aggregate with string key
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Aggregate w string key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 4885 4929 62 4.3 232.9 1.0X
codegen = T, hashmap = F 3494 3500 6 6.0 166.6 1.4X
codegen = T, row-based hashmap = T 2341 2378 43 9.0 111.6 2.1X
codegen = T, vectorized hashmap = T 2214 2270 46 9.5 105.6 2.2X
================================================================================================
aggregate with decimal key
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Aggregate w decimal key: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 3359 3363 5 6.2 160.2 1.0X
codegen = T, hashmap = F 2015 2049 48 10.4 96.1 1.7X
codegen = T, row-based hashmap = T 747 757 8 28.1 35.6 4.5X
codegen = T, vectorized hashmap = T 568 622 52 36.9 27.1 5.9X
================================================================================================
aggregate with multiple key types
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
Aggregate w multiple keys: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 7719 7743 34 2.7 368.1 1.0X
codegen = T, hashmap = F 4683 4700 23 4.5 223.3 1.6X
codegen = T, row-based hashmap = T 3862 3902 57 5.4 184.2 2.0X
codegen = T, vectorized hashmap = T 3752 3789 52 5.6 178.9 2.1X
================================================================================================
max function bytecode size of wholestagecodegen
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
max function bytecode size: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
codegen = F 477 501 30 1.4 728.1 1.0X
codegen = T, hugeMethodLimit = 10000 213 231 12 3.1 324.9 2.2X
codegen = T, hugeMethodLimit = 1500 205 214 9 3.2 313.0 2.3X
================================================================================================
cube
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
cube: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
cube wholestage off 2843 2897 75 1.8 542.3 1.0X
cube wholestage on 1524 1543 19 3.4 290.7 1.9X
================================================================================================
hash and BytesToBytesMap
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) CPU E5-2673 v3 @ 2.40GHz
BytesToBytesMap: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
UnsafeRowhash 285 290 5 73.5 13.6 1.0X
murmur3 hash 129 139 6 162.8 6.1 2.2X
fast hash 72 78 8 289.9 3.4 3.9X
arrayEqual 194 201 4 107.9 9.3 1.5X
Java HashMap (Long) 123 133 7 170.2 5.9 2.3X
Java HashMap (two ints) 145 154 7 144.8 6.9 2.0X
Java HashMap (UnsafeRow) 816 824 7 25.7 38.9 0.3X
LongToUnsafeRowMap (opt=false) 468 479 10 44.8 22.3 0.6X
LongToUnsafeRowMap (opt=true) 101 104 3 208.0 4.8 2.8X
BytesToBytesMap (off Heap) 897 921 30 23.4 42.8 0.3X
BytesToBytesMap (on Heap) 903 910 8 23.2 43.0 0.3X
Aggregate HashMap 53 57 3 399.4 2.5 5.4X