-
Notifications
You must be signed in to change notification settings - Fork 28k
/
CoalescedRDDBenchmark-results.txt
40 lines (37 loc) · 4.24 KB
/
CoalescedRDDBenchmark-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
================================================================================================
Coalesced RDD , large scale
================================================================================================
OpenJDK 64-Bit Server VM 1.8.0_362-b09 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 296 331 32 0.3 2956.6 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 206 220 16 0.5 2062.0 1.4X
Coalesce Num Partitions: 100 Num Hosts: 10 198 211 24 0.5 1976.2 1.5X
Coalesce Num Partitions: 100 Num Hosts: 20 188 193 7 0.5 1878.6 1.6X
Coalesce Num Partitions: 100 Num Hosts: 40 185 186 2 0.5 1848.8 1.6X
Coalesce Num Partitions: 100 Num Hosts: 80 193 195 2 0.5 1926.4 1.5X
Coalesce Num Partitions: 500 Num Hosts: 1 694 729 47 0.1 6942.7 0.4X
Coalesce Num Partitions: 500 Num Hosts: 5 287 292 5 0.3 2873.6 1.0X
Coalesce Num Partitions: 500 Num Hosts: 10 241 244 3 0.4 2410.4 1.2X
Coalesce Num Partitions: 500 Num Hosts: 20 218 236 17 0.5 2182.7 1.4X
Coalesce Num Partitions: 500 Num Hosts: 40 201 214 16 0.5 2009.9 1.5X
Coalesce Num Partitions: 500 Num Hosts: 80 201 212 10 0.5 2011.6 1.5X
Coalesce Num Partitions: 1000 Num Hosts: 1 1160 1163 3 0.1 11597.0 0.3X
Coalesce Num Partitions: 1000 Num Hosts: 5 389 398 15 0.3 3895.0 0.8X
Coalesce Num Partitions: 1000 Num Hosts: 10 296 302 9 0.3 2959.5 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 20 243 246 5 0.4 2428.5 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 40 225 239 15 0.4 2248.1 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 80 217 217 1 0.5 2166.1 1.4X
Coalesce Num Partitions: 5000 Num Hosts: 1 4840 4841 2 0.0 48395.4 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 1135 1137 2 0.1 11349.7 0.3X
Coalesce Num Partitions: 5000 Num Hosts: 10 668 674 7 0.1 6684.1 0.4X
Coalesce Num Partitions: 5000 Num Hosts: 20 452 457 4 0.2 4524.9 0.7X
Coalesce Num Partitions: 5000 Num Hosts: 40 314 321 12 0.3 3142.1 0.9X
Coalesce Num Partitions: 5000 Num Hosts: 80 261 263 2 0.4 2610.6 1.1X
Coalesce Num Partitions: 10000 Num Hosts: 1 9409 9454 45 0.0 94087.0 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 2439 2457 16 0.0 24389.2 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 10 1298 1303 6 0.1 12984.1 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 20 761 764 3 0.1 7613.9 0.4X
Coalesce Num Partitions: 10000 Num Hosts: 40 496 503 12 0.2 4962.0 0.6X
Coalesce Num Partitions: 10000 Num Hosts: 80 348 368 18 0.3 3477.3 0.9X