/
WideSchemaBenchmark-jdk17-results.txt
145 lines (124 loc) · 12.9 KB
/
WideSchemaBenchmark-jdk17-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
================================================================================================
parsing large select expressions
================================================================================================
OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
parsing large select: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 select expressions 2 2 2 0.0 1585386.0 1.0X
100 select expressions 6 8 5 0.0 5693310.0 0.3X
2500 select expressions 101 118 13 0.0 101265083.0 0.0X
================================================================================================
many column field read and write
================================================================================================
OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
many column field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 cols x 100000 rows (read in-mem) 24 32 7 4.2 238.0 1.0X
1 cols x 100000 rows (exec in-mem) 29 35 6 3.4 290.3 0.8X
1 cols x 100000 rows (read parquet) 48 59 15 2.1 478.0 0.5X
1 cols x 100000 rows (write parquet) 164 173 9 0.6 1640.1 0.1X
100 cols x 1000 rows (read in-mem) 27 31 5 3.8 266.4 0.9X
100 cols x 1000 rows (exec in-mem) 39 45 7 2.6 389.6 0.6X
100 cols x 1000 rows (read parquet) 51 60 11 2.0 506.0 0.5X
100 cols x 1000 rows (write parquet) 161 176 11 0.6 1611.0 0.1X
2500 cols x 40 rows (read in-mem) 180 205 23 0.6 1798.1 0.1X
2500 cols x 40 rows (exec in-mem) 379 414 33 0.3 3793.4 0.1X
2500 cols x 40 rows (read parquet) 797 805 10 0.1 7974.7 0.0X
2500 cols x 40 rows (write parquet) 285 308 17 0.4 2850.7 0.1X
================================================================================================
wide shallowly nested struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
wide shallowly nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 35 44 8 2.9 350.4 1.0X
1 wide x 100000 rows (exec in-mem) 41 50 5 2.4 408.5 0.9X
1 wide x 100000 rows (read parquet) 69 80 10 1.5 687.1 0.5X
1 wide x 100000 rows (write parquet) 161 174 8 0.6 1610.0 0.2X
100 wide x 1000 rows (read in-mem) 29 36 9 3.4 292.3 1.2X
100 wide x 1000 rows (exec in-mem) 47 53 6 2.1 466.0 0.8X
100 wide x 1000 rows (read parquet) 47 55 8 2.1 470.9 0.7X
100 wide x 1000 rows (write parquet) 156 167 9 0.6 1562.2 0.2X
2500 wide x 40 rows (read in-mem) 51 57 7 2.0 505.5 0.7X
2500 wide x 40 rows (exec in-mem) 570 586 12 0.2 5704.9 0.1X
2500 wide x 40 rows (read parquet) 168 176 6 0.6 1677.2 0.2X
2500 wide x 40 rows (write parquet) 187 197 10 0.5 1868.5 0.2X
================================================================================================
deeply nested struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
deeply nested struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 deep x 100000 rows (read in-mem) 32 38 8 3.1 323.2 1.0X
1 deep x 100000 rows (exec in-mem) 36 43 7 2.8 355.2 0.9X
1 deep x 100000 rows (read parquet) 55 63 8 1.8 547.9 0.6X
1 deep x 100000 rows (write parquet) 164 170 6 0.6 1644.1 0.2X
100 deep x 1000 rows (read in-mem) 86 93 7 1.2 860.2 0.4X
100 deep x 1000 rows (exec in-mem) 875 920 40 0.1 8745.3 0.0X
100 deep x 1000 rows (read parquet) 717 735 23 0.1 7169.2 0.0X
100 deep x 1000 rows (write parquet) 203 212 7 0.5 2034.2 0.2X
250 deep x 400 rows (read in-mem) 375 422 50 0.3 3749.5 0.1X
250 deep x 400 rows (exec in-mem) 5144 5180 51 0.0 51438.2 0.0X
250 deep x 400 rows (read parquet) 3965 4093 181 0.0 39652.4 0.0X
250 deep x 400 rows (write parquet) 499 518 13 0.2 4992.4 0.1X
================================================================================================
bushy struct field read and write
================================================================================================
OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
bushy struct field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
-------------------------------------------------------------------------------------------------------------------------
1 x 1 deep x 100000 rows (read in-mem) 25 30 6 4.0 249.0 1.0X
1 x 1 deep x 100000 rows (exec in-mem) 31 36 6 3.3 306.4 0.8X
1 x 1 deep x 100000 rows (read parquet) 34 39 7 2.9 341.5 0.7X
1 x 1 deep x 100000 rows (write parquet) 149 159 7 0.7 1489.7 0.2X
128 x 8 deep x 1000 rows (read in-mem) 28 33 6 3.6 277.1 0.9X
128 x 8 deep x 1000 rows (exec in-mem) 54 62 7 1.8 541.1 0.5X
128 x 8 deep x 1000 rows (read parquet) 45 53 6 2.2 448.8 0.6X
128 x 8 deep x 1000 rows (write parquet) 150 161 5 0.7 1499.1 0.2X
1024 x 11 deep x 100 rows (read in-mem) 41 48 5 2.5 407.8 0.6X
1024 x 11 deep x 100 rows (exec in-mem) 339 383 33 0.3 3393.4 0.1X
1024 x 11 deep x 100 rows (read parquet) 80 91 7 1.2 803.8 0.3X
1024 x 11 deep x 100 rows (write parquet) 171 181 8 0.6 1708.4 0.1X
================================================================================================
wide array field read and write
================================================================================================
OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
wide array field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 30 35 5 3.3 300.9 1.0X
1 wide x 100000 rows (exec in-mem) 34 37 5 3.0 335.2 0.9X
1 wide x 100000 rows (read parquet) 62 68 5 1.6 623.1 0.5X
1 wide x 100000 rows (write parquet) 160 171 8 0.6 1598.1 0.2X
100 wide x 1000 rows (read in-mem) 23 29 6 4.3 231.4 1.3X
100 wide x 1000 rows (exec in-mem) 26 31 5 3.9 259.7 1.2X
100 wide x 1000 rows (read parquet) 40 44 5 2.5 399.0 0.8X
100 wide x 1000 rows (write parquet) 154 164 6 0.6 1540.1 0.2X
2500 wide x 40 rows (read in-mem) 23 27 4 4.3 234.0 1.3X
2500 wide x 40 rows (exec in-mem) 26 31 5 3.8 263.6 1.1X
2500 wide x 40 rows (read parquet) 38 44 5 2.6 380.6 0.8X
2500 wide x 40 rows (write parquet) 149 159 8 0.7 1486.5 0.2X
================================================================================================
wide map field read and write
================================================================================================
OpenJDK 64-Bit Server VM 17.0.1+12-LTS on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
wide map field r/w: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
1 wide x 100000 rows (read in-mem) 23 28 3 4.3 231.5 1.0X
1 wide x 100000 rows (exec in-mem) 30 36 4 3.3 304.4 0.8X
1 wide x 100000 rows (read parquet) 85 97 9 1.2 851.6 0.3X
1 wide x 100000 rows (write parquet) 152 161 6 0.7 1521.0 0.2X
100 wide x 1000 rows (read in-mem) 13 16 3 7.6 131.8 1.8X
100 wide x 1000 rows (exec in-mem) 18 21 3 5.7 176.2 1.3X
100 wide x 1000 rows (read parquet) 46 54 7 2.2 458.5 0.5X
100 wide x 1000 rows (write parquet) 138 146 5 0.7 1377.6 0.2X
2500 wide x 40 rows (read in-mem) 16 19 3 6.3 157.5 1.5X
2500 wide x 40 rows (exec in-mem) 19 23 4 5.4 185.1 1.3X
2500 wide x 40 rows (read parquet) 48 55 6 2.1 476.0 0.5X
2500 wide x 40 rows (write parquet) 142 149 7 0.7 1417.5 0.2X