/
DatasetBenchmark-jdk11-results.txt
46 lines (39 loc) · 3.81 KB
/
DatasetBenchmark-jdk11-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
================================================================================================
Dataset Benchmark
================================================================================================
OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
back-to-back map long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 9460 9689 325 10.6 94.6 1.0X
DataFrame 1510 1712 285 66.2 15.1 6.3X
Dataset 2256 2493 336 44.3 22.6 4.2X
OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
back-to-back map: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 11086 11159 104 9.0 110.9 1.0X
DataFrame 3891 3900 12 25.7 38.9 2.8X
Dataset 13372 13416 62 7.5 133.7 0.8X
OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
back-to-back filter Long: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 2603 2612 12 38.4 26.0 1.0X
DataFrame 1025 1050 35 97.6 10.3 2.5X
Dataset 2680 2735 78 37.3 26.8 1.0X
OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
back-to-back filter: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD 3110 3139 41 32.2 31.1 1.0X
DataFrame 155 201 39 643.9 1.6 20.0X
Dataset 4328 4357 41 23.1 43.3 0.7X
OpenJDK 64-Bit Server VM 11.0.17+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
aggregate: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
------------------------------------------------------------------------------------------------------------------------
RDD sum 3091 3127 50 32.3 30.9 1.0X
DataFrame sum 72 104 29 1385.1 0.7 42.8X
Dataset sum using Aggregator 4189 4244 78 23.9 41.9 0.7X
Dataset complex Aggregator 8592 8597 6 11.6 85.9 0.4X