-
Notifications
You must be signed in to change notification settings - Fork 28k
/
CoalescedRDDBenchmark-results.txt
40 lines (37 loc) · 4.24 KB
/
CoalescedRDDBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
================================================================================================
Coalesced RDD , large scale
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_352-b08 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8370C CPU @ 2.80GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 235 247 21 0.4 2346.8 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 167 176 14 0.6 1669.7 1.4X
Coalesce Num Partitions: 100 Num Hosts: 10 163 163 1 0.6 1626.8 1.4X
Coalesce Num Partitions: 100 Num Hosts: 20 157 160 2 0.6 1571.1 1.5X
Coalesce Num Partitions: 100 Num Hosts: 40 155 168 16 0.6 1547.4 1.5X
Coalesce Num Partitions: 100 Num Hosts: 80 151 162 17 0.7 1508.3 1.6X
Coalesce Num Partitions: 500 Num Hosts: 1 594 608 22 0.2 5935.5 0.4X
Coalesce Num Partitions: 500 Num Hosts: 5 245 255 12 0.4 2448.8 1.0X
Coalesce Num Partitions: 500 Num Hosts: 10 198 214 24 0.5 1981.3 1.2X
Coalesce Num Partitions: 500 Num Hosts: 20 178 183 5 0.6 1784.0 1.3X
Coalesce Num Partitions: 500 Num Hosts: 40 161 168 7 0.6 1605.9 1.5X
Coalesce Num Partitions: 500 Num Hosts: 80 168 171 3 0.6 1682.5 1.4X
Coalesce Num Partitions: 1000 Num Hosts: 1 1018 1021 3 0.1 10182.6 0.2X
Coalesce Num Partitions: 1000 Num Hosts: 5 330 336 6 0.3 3296.7 0.7X
Coalesce Num Partitions: 1000 Num Hosts: 10 244 244 1 0.4 2437.6 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 20 199 211 18 0.5 1989.6 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 40 176 186 16 0.6 1758.0 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 80 163 165 2 0.6 1626.6 1.4X
Coalesce Num Partitions: 5000 Num Hosts: 1 4264 4270 5 0.0 42644.7 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 1016 1024 9 0.1 10155.1 0.2X
Coalesce Num Partitions: 5000 Num Hosts: 10 594 605 15 0.2 5940.8 0.4X
Coalesce Num Partitions: 5000 Num Hosts: 20 383 387 6 0.3 3827.4 0.6X
Coalesce Num Partitions: 5000 Num Hosts: 40 274 275 1 0.4 2743.5 0.9X
Coalesce Num Partitions: 5000 Num Hosts: 80 216 226 12 0.5 2159.3 1.1X
Coalesce Num Partitions: 10000 Num Hosts: 1 8451 8478 27 0.0 84505.5 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 1919 1939 34 0.1 19185.3 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 1053 1060 11 0.1 10533.1 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 20 619 635 19 0.2 6187.0 0.4X
Coalesce Num Partitions: 10000 Num Hosts: 40 404 414 10 0.2 4036.4 0.6X
Coalesce Num Partitions: 10000 Num Hosts: 80 279 287 10 0.4 2785.6 0.8X