/
DateTimeRebaseBenchmark-results.txt
154 lines (138 loc) · 14.6 KB
/
DateTimeRebaseBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
================================================================================================
Rebasing dates/timestamps in Parquet datasource
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Save DATE to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1582, noop 24619 24619 0 4.1 246.2 1.0X
before 1582, noop 12468 12468 0 8.0 124.7 2.0X
after 1582, rebase EXCEPTION 34988 34988 0 2.9 349.9 0.7X
after 1582, rebase LEGACY 34922 34922 0 2.9 349.2 0.7X
after 1582, rebase CORRECTED 35229 35229 0 2.8 352.3 0.7X
before 1582, rebase LEGACY 23800 23800 0 4.2 238.0 1.0X
before 1582, rebase CORRECTED 22905 22905 0 4.4 229.1 1.1X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Load DATE from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1582, vec off, rebase EXCEPTION 15197 15292 134 6.6 152.0 1.0X
after 1582, vec off, rebase LEGACY 15146 15164 18 6.6 151.5 1.0X
after 1582, vec off, rebase CORRECTED 15445 15666 239 6.5 154.4 1.0X
after 1582, vec on, rebase EXCEPTION 4647 4665 16 21.5 46.5 3.3X
after 1582, vec on, rebase LEGACY 4804 4825 18 20.8 48.0 3.2X
after 1582, vec on, rebase CORRECTED 4611 4645 50 21.7 46.1 3.3X
before 1582, vec off, rebase LEGACY 15691 15749 50 6.4 156.9 1.0X
before 1582, vec off, rebase CORRECTED 15827 15861 46 6.3 158.3 1.0X
before 1582, vec on, rebase LEGACY 5748 5753 7 17.4 57.5 2.6X
before 1582, vec on, rebase CORRECTED 4700 4728 24 21.3 47.0 3.2X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Save TIMESTAMP_INT96 to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, noop 3932 3932 0 25.4 39.3 1.0X
before 1900, noop 3838 3838 0 26.1 38.4 1.0X
after 1900, rebase EXCEPTION 28398 28398 0 3.5 284.0 0.1X
after 1900, rebase LEGACY 28915 28915 0 3.5 289.1 0.1X
after 1900, rebase CORRECTED 28953 28953 0 3.5 289.5 0.1X
before 1900, rebase LEGACY 31520 31520 0 3.2 315.2 0.1X
before 1900, rebase CORRECTED 29298 29298 0 3.4 293.0 0.1X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Load TIMESTAMP_INT96 from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, vec off, rebase EXCEPTION 18872 18906 49 5.3 188.7 1.0X
after 1900, vec off, rebase LEGACY 18824 18902 122 5.3 188.2 1.0X
after 1900, vec off, rebase CORRECTED 18850 18873 21 5.3 188.5 1.0X
after 1900, vec on, rebase EXCEPTION 9363 9495 144 10.7 93.6 2.0X
after 1900, vec on, rebase LEGACY 9627 9644 15 10.4 96.3 2.0X
after 1900, vec on, rebase CORRECTED 9406 9454 71 10.6 94.1 2.0X
before 1900, vec off, rebase LEGACY 22231 22426 172 4.5 222.3 0.8X
before 1900, vec off, rebase CORRECTED 19744 19801 49 5.1 197.4 1.0X
before 1900, vec on, rebase LEGACY 12144 12216 79 8.2 121.4 1.6X
before 1900, vec on, rebase CORRECTED 9503 9518 16 10.5 95.0 2.0X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Save TIMESTAMP_MICROS to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, noop 3684 3684 0 27.1 36.8 1.0X
before 1900, noop 3717 3717 0 26.9 37.2 1.0X
after 1900, rebase EXCEPTION 17593 17593 0 5.7 175.9 0.2X
after 1900, rebase LEGACY 18604 18604 0 5.4 186.0 0.2X
after 1900, rebase CORRECTED 17897 17897 0 5.6 179.0 0.2X
before 1900, rebase LEGACY 19994 19994 0 5.0 199.9 0.2X
before 1900, rebase CORRECTED 18247 18247 0 5.5 182.5 0.2X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Load TIMESTAMP_MICROS from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, vec off, rebase EXCEPTION 17172 17285 99 5.8 171.7 1.0X
after 1900, vec off, rebase LEGACY 17695 17797 94 5.7 177.0 1.0X
after 1900, vec off, rebase CORRECTED 17702 17733 37 5.6 177.0 1.0X
after 1900, vec on, rebase EXCEPTION 6180 6241 55 16.2 61.8 2.8X
after 1900, vec on, rebase LEGACY 7002 7019 19 14.3 70.0 2.5X
after 1900, vec on, rebase CORRECTED 6154 6184 27 16.3 61.5 2.8X
before 1900, vec off, rebase LEGACY 20866 21070 183 4.8 208.7 0.8X
before 1900, vec off, rebase CORRECTED 17521 17604 75 5.7 175.2 1.0X
before 1900, vec on, rebase LEGACY 9508 9551 52 10.5 95.1 1.8X
before 1900, vec on, rebase CORRECTED 6136 6184 48 16.3 61.4 2.8X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Save TIMESTAMP_MILLIS to parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, noop 3762 3762 0 26.6 37.6 1.0X
before 1900, noop 3780 3780 0 26.5 37.8 1.0X
after 1900, rebase EXCEPTION 16950 16950 0 5.9 169.5 0.2X
after 1900, rebase LEGACY 17179 17179 0 5.8 171.8 0.2X
after 1900, rebase CORRECTED 17616 17616 0 5.7 176.2 0.2X
before 1900, rebase LEGACY 20179 20179 0 5.0 201.8 0.2X
before 1900, rebase CORRECTED 17666 17666 0 5.7 176.7 0.2X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Load TIMESTAMP_MILLIS from parquet: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, vec off, rebase EXCEPTION 18870 18930 62 5.3 188.7 1.0X
after 1900, vec off, rebase LEGACY 18420 18459 62 5.4 184.2 1.0X
after 1900, vec off, rebase CORRECTED 17979 18165 193 5.6 179.8 1.0X
after 1900, vec on, rebase EXCEPTION 7407 7425 21 13.5 74.1 2.5X
after 1900, vec on, rebase LEGACY 7830 7859 29 12.8 78.3 2.4X
after 1900, vec on, rebase CORRECTED 7335 7384 45 13.6 73.4 2.6X
before 1900, vec off, rebase LEGACY 21360 21628 234 4.7 213.6 0.9X
before 1900, vec off, rebase CORRECTED 18124 18143 30 5.5 181.2 1.0X
before 1900, vec on, rebase LEGACY 9984 10024 43 10.0 99.8 1.9X
before 1900, vec on, rebase CORRECTED 7411 7461 73 13.5 74.1 2.5X
================================================================================================
Rebasing dates/timestamps in ORC datasource
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Save DATE to ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1582, noop 24702 24702 0 4.0 247.0 1.0X
before 1582, noop 12677 12677 0 7.9 126.8 1.9X
after 1582 31386 31386 0 3.2 313.9 0.8X
before 1582 19869 19869 0 5.0 198.7 1.2X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Load DATE from ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1582, vec off 14471 14494 22 6.9 144.7 1.0X
after 1582, vec on 4715 4786 82 21.2 47.2 3.1X
before 1582, vec off 14543 14596 46 6.9 145.4 1.0X
before 1582, vec on 4952 5082 139 20.2 49.5 2.9X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Save TIMESTAMP to ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, noop 3872 3872 0 25.8 38.7 1.0X
before 1900, noop 3778 3778 0 26.5 37.8 1.0X
after 1900 16066 16066 0 6.2 160.7 0.2X
before 1900 18556 18556 0 5.4 185.6 0.2X
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Load TIMESTAMP from ORC: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
after 1900, vec off 16927 16944 26 5.9 169.3 1.0X
after 1900, vec on 7060 7126 64 14.2 70.6 2.4X
before 1900, vec off 18992 19006 13 5.3 189.9 0.9X
before 1900, vec on 9226 9234 7 10.8 92.3 1.8X