-
Notifications
You must be signed in to change notification settings - Fork 28k
/
DateTimeRebaseBenchmark-results.txt
154 lines (138 loc) · 14.6 KB
/
DateTimeRebaseBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
================================================================================================
Rebasing dates/timestamps in Parquet datasource
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Save DATE to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1582, noop 20445 20445 0 4.9 204.5 1.0X
before 1582, noop 9312 9312 0 10.7 93.1 2.2X
after 1582, rebase EXCEPTION 32497 32497 0 3.1 325.0 0.6X
after 1582, rebase LEGACY 32446 32446 0 3.1 324.5 0.6X
after 1582, rebase CORRECTED 32805 32805 0 3.0 328.0 0.6X
before 1582, rebase LEGACY 21165 21165 0 4.7 211.7 1.0X
before 1582, rebase CORRECTED 20951 20951 0 4.8 209.5 1.0X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Load DATE from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1582, vec off, rebase EXCEPTION 12137 12157 18 8.2 121.4 1.0X
after 1582, vec off, rebase LEGACY 11911 11925 13 8.4 119.1 1.0X
after 1582, vec off, rebase CORRECTED 12287 12325 34 8.1 122.9 1.0X
after 1582, vec on, rebase EXCEPTION 3139 3179 43 31.9 31.4 3.9X
after 1582, vec on, rebase LEGACY 3310 3338 45 30.2 33.1 3.7X
after 1582, vec on, rebase CORRECTED 3121 3132 11 32.0 31.2 3.9X
before 1582, vec off, rebase LEGACY 12472 12522 76 8.0 124.7 1.0X
before 1582, vec off, rebase CORRECTED 12520 12628 95 8.0 125.2 1.0X
before 1582, vec on, rebase LEGACY 3821 3871 68 26.2 38.2 3.2X
before 1582, vec on, rebase CORRECTED 3097 3107 11 32.3 31.0 3.9X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Save TIMESTAMP_INT96 to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, noop 2451 2451 0 40.8 24.5 1.0X
before 1900, noop 2380 2380 0 42.0 23.8 1.0X
after 1900, rebase EXCEPTION 28964 28964 0 3.5 289.6 0.1X
after 1900, rebase LEGACY 28876 28876 0 3.5 288.8 0.1X
after 1900, rebase CORRECTED 29153 29153 0 3.4 291.5 0.1X
before 1900, rebase LEGACY 31505 31505 0 3.2 315.0 0.1X
before 1900, rebase CORRECTED 29437 29437 0 3.4 294.4 0.1X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Load TIMESTAMP_INT96 from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, vec off, rebase EXCEPTION 15315 15356 37 6.5 153.2 1.0X
after 1900, vec off, rebase LEGACY 15495 15511 14 6.5 154.9 1.0X
after 1900, vec off, rebase CORRECTED 15470 15532 64 6.5 154.7 1.0X
after 1900, vec on, rebase EXCEPTION 6938 6951 14 14.4 69.4 2.2X
after 1900, vec on, rebase LEGACY 7203 7228 39 13.9 72.0 2.1X
after 1900, vec on, rebase CORRECTED 6953 6989 34 14.4 69.5 2.2X
before 1900, vec off, rebase LEGACY 18929 19000 64 5.3 189.3 0.8X
before 1900, vec off, rebase CORRECTED 16205 16226 20 6.2 162.1 0.9X
before 1900, vec on, rebase LEGACY 9162 9183 18 10.9 91.6 1.7X
before 1900, vec on, rebase CORRECTED 6944 6981 36 14.4 69.4 2.2X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Save TIMESTAMP_MICROS to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, noop 2398 2398 0 41.7 24.0 1.0X
before 1900, noop 2375 2375 0 42.1 23.8 1.0X
after 1900, rebase EXCEPTION 13554 13554 0 7.4 135.5 0.2X
after 1900, rebase LEGACY 13834 13834 0 7.2 138.3 0.2X
after 1900, rebase CORRECTED 14185 14185 0 7.0 141.8 0.2X
before 1900, rebase LEGACY 16900 16900 0 5.9 169.0 0.1X
before 1900, rebase CORRECTED 13892 13892 0 7.2 138.9 0.2X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Load TIMESTAMP_MICROS from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, vec off, rebase EXCEPTION 14297 14574 254 7.0 143.0 1.0X
after 1900, vec off, rebase LEGACY 14746 14808 67 6.8 147.5 1.0X
after 1900, vec off, rebase CORRECTED 14438 14491 48 6.9 144.4 1.0X
after 1900, vec on, rebase EXCEPTION 4492 4594 156 22.3 44.9 3.2X
after 1900, vec on, rebase LEGACY 5142 5159 15 19.4 51.4 2.8X
after 1900, vec on, rebase CORRECTED 4516 4540 33 22.1 45.2 3.2X
before 1900, vec off, rebase LEGACY 17406 17505 102 5.7 174.1 0.8X
before 1900, vec off, rebase CORRECTED 14463 14521 63 6.9 144.6 1.0X
before 1900, vec on, rebase LEGACY 7389 7414 32 13.5 73.9 1.9X
before 1900, vec on, rebase CORRECTED 4499 4564 98 22.2 45.0 3.2X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Save TIMESTAMP_MILLIS to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, noop 2390 2390 0 41.8 23.9 1.0X
before 1900, noop 2443 2443 0 40.9 24.4 1.0X
after 1900, rebase EXCEPTION 13299 13299 0 7.5 133.0 0.2X
after 1900, rebase LEGACY 13378 13378 0 7.5 133.8 0.2X
after 1900, rebase CORRECTED 13544 13544 0 7.4 135.4 0.2X
before 1900, rebase LEGACY 16609 16609 0 6.0 166.1 0.1X
before 1900, rebase CORRECTED 13843 13843 0 7.2 138.4 0.2X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Load TIMESTAMP_MILLIS from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, vec off, rebase EXCEPTION 15757 15794 33 6.3 157.6 1.0X
after 1900, vec off, rebase LEGACY 15775 15825 47 6.3 157.7 1.0X
after 1900, vec off, rebase CORRECTED 15750 15773 23 6.3 157.5 1.0X
after 1900, vec on, rebase EXCEPTION 5270 5285 15 19.0 52.7 3.0X
after 1900, vec on, rebase LEGACY 5830 5850 22 17.2 58.3 2.7X
after 1900, vec on, rebase CORRECTED 5282 5355 108 18.9 52.8 3.0X
before 1900, vec off, rebase LEGACY 18290 18324 29 5.5 182.9 0.9X
before 1900, vec off, rebase CORRECTED 15712 15730 15 6.4 157.1 1.0X
before 1900, vec on, rebase LEGACY 7632 7670 40 13.1 76.3 2.1X
before 1900, vec on, rebase CORRECTED 5303 5331 43 18.9 53.0 3.0X
================================================================================================
Rebasing dates/timestamps in ORC datasource
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Save DATE to ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1582, noop 20539 20539 0 4.9 205.4 1.0X
before 1582, noop 9395 9395 0 10.6 93.9 2.2X
after 1582 26247 26247 0 3.8 262.5 0.8X
before 1582 15267 15267 0 6.6 152.7 1.3X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Load DATE from ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1582, vec off 8432 8465 31 11.9 84.3 1.0X
after 1582, vec on 3250 3257 7 30.8 32.5 2.6X
before 1582, vec off 8576 8608 32 11.7 85.8 1.0X
before 1582, vec on 3606 3620 14 27.7 36.1 2.3X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Save TIMESTAMP to ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, noop 2658 2658 0 37.6 26.6 1.0X
before 1900, noop 2402 2402 0 41.6 24.0 1.1X
after 1900 11906 11906 0 8.4 119.1 0.2X
before 1900 14321 14321 0 7.0 143.2 0.2X
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Load TIMESTAMP from ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, vec off 9737 9757 20 10.3 97.4 1.0X
after 1900, vec on 4944 5001 49 20.2 49.4 2.0X
before 1900, vec off 12142 12200 55 8.2 121.4 0.8X
before 1900, vec on 6745 6922 218 14.8 67.5 1.4X