-
Notifications
You must be signed in to change notification settings - Fork 28k
/
JsonBenchmark-results.txt
120 lines (106 loc) · 10.1 KB
/
JsonBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
================================================================================================
Benchmark for performance of JSON parsing
================================================================================================
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
JSON schema inferring: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 3730 3744 17 1.3 745.9 1.0X
UTF-8 is set 6110 6145 31 0.8 1222.1 0.6X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
count a short column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 2796 2838 69 1.8 559.1 1.0X
UTF-8 is set 4701 4776 73 1.1 940.2 0.6X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
count a wide column: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 5725 5793 70 0.2 5725.4 1.0X
UTF-8 is set 9945 9971 26 0.1 9944.8 0.6X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
select wide row: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
No encoding 15318 15488 196 0.0 306357.4 1.0X
UTF-8 is set 17210 17218 13 0.0 344191.9 0.9X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Select a subset of 10 columns: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Select 10 columns 2184 2216 28 0.5 2184.1 1.0X
Select 1 column 1809 1836 24 0.6 1808.9 1.2X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
creation of JSON parser per line: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Short column without encoding 831 836 5 1.2 831.1 1.0X
Short column with UTF-8 1233 1249 16 0.8 1232.8 0.7X
Wide column without encoding 12372 12468 125 0.1 12371.6 0.1X
Wide column with UTF-8 16097 16262 145 0.1 16097.3 0.1X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
JSON functions: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 155 159 4 6.4 155.5 1.0X
from_json 2801 2821 19 0.4 2801.4 0.1X
json_tuple 3163 3182 21 0.3 3163.3 0.0X
get_json_object 2976 2987 10 0.3 2975.9 0.1X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Dataset of json strings: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 632 642 9 7.9 126.4 1.0X
schema inferring 3029 3085 56 1.7 605.7 0.2X
parsing 3134 3256 108 1.6 626.8 0.2X
Preparing data for benchmarking ...
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Json files in the per-line mode: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Text read 1011 1054 37 4.9 202.1 1.0X
Schema inferring 3672 3699 24 1.4 734.4 0.3X
Parsing without charset 3682 3711 25 1.4 736.5 0.3X
Parsing with UTF-8 5490 5534 45 0.9 1098.0 0.2X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Write dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
Create a dataset of timestamps 173 189 15 5.8 173.0 1.0X
to_json(timestamp) 1376 1422 51 0.7 1376.1 0.1X
write timestamps to files 1212 1217 5 0.8 1211.7 0.1X
Create a dataset of dates 202 208 6 5.0 201.9 0.9X
to_json(date) 950 968 16 1.1 950.4 0.2X
write dates to files 729 754 24 1.4 729.3 0.2X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Read dates and timestamps: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
read timestamp text from files 254 260 6 3.9 254.5 1.0X
read timestamps from files 2969 3011 48 0.3 2968.6 0.1X
infer timestamps from files 14140 14240 119 0.1 14139.7 0.0X
read date text from files 234 240 5 4.3 234.0 1.1X
read date from files 950 953 4 1.1 949.8 0.3X
timestamp strings 369 392 38 2.7 368.6 0.7X
parse timestamps from Dataset[String] 3431 3469 63 0.3 3430.6 0.1X
infer timestamps from Dataset[String] 14584 14629 42 0.1 14583.6 0.0X
date strings 452 466 21 2.2 452.2 0.6X
parse dates from Dataset[String] 1507 1513 9 0.7 1506.7 0.2X
from_json(timestamp) 5475 5531 57 0.2 5474.7 0.0X
from_json(date) 3414 3430 21 0.3 3414.2 0.1X
OpenJDK 64-Bit Server VM 1.8.0_312-b07 on Linux 5.11.0-1022-azure
Intel(R) Xeon(R) CPU E5-2673 v4 @ 2.30GHz
Filters pushdown: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
w/o filters 23149 23248 86 0.0 231485.2 1.0X
pushdown disabled 22533 22698 143 0.0 225325.4 1.0X
w/ filters 737 747 9 0.1 7373.9 31.4X