-
Notifications
You must be signed in to change notification settings - Fork 28k
/
CoalescedRDDBenchmark-jdk17-results.txt
40 lines (37 loc) · 4.23 KB
/
CoalescedRDDBenchmark-jdk17-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
================================================================================================
Coalesced RDD , large scale
================================================================================================
OpenJDK 64-Bit Server VM 17.0.6+10 on Linux 5.15.0-1031-azure
Intel(R) Xeon(R) Platinum 8272CL CPU @ 2.60GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 289 294 5 0.3 2889.9 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 255 268 12 0.4 2549.2 1.1X
Coalesce Num Partitions: 100 Num Hosts: 10 242 261 22 0.4 2419.2 1.2X
Coalesce Num Partitions: 100 Num Hosts: 20 249 256 6 0.4 2487.2 1.2X
Coalesce Num Partitions: 100 Num Hosts: 40 225 233 8 0.4 2252.4 1.3X
Coalesce Num Partitions: 100 Num Hosts: 80 246 252 7 0.4 2461.9 1.2X
Coalesce Num Partitions: 500 Num Hosts: 1 403 414 13 0.2 4026.3 0.7X
Coalesce Num Partitions: 500 Num Hosts: 5 249 257 8 0.4 2490.7 1.2X
Coalesce Num Partitions: 500 Num Hosts: 10 270 272 2 0.4 2700.0 1.1X
Coalesce Num Partitions: 500 Num Hosts: 20 227 231 5 0.4 2268.1 1.3X
Coalesce Num Partitions: 500 Num Hosts: 40 220 228 8 0.5 2204.0 1.3X
Coalesce Num Partitions: 500 Num Hosts: 80 222 230 8 0.5 2216.0 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 1 617 632 20 0.2 6166.2 0.5X
Coalesce Num Partitions: 1000 Num Hosts: 5 292 303 18 0.3 2917.3 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 10 246 259 20 0.4 2460.7 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 20 269 272 3 0.4 2686.2 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 40 229 234 5 0.4 2285.1 1.3X
Coalesce Num Partitions: 1000 Num Hosts: 80 251 254 3 0.4 2507.0 1.2X
Coalesce Num Partitions: 5000 Num Hosts: 1 1980 1999 20 0.1 19796.6 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 581 593 15 0.2 5813.2 0.5X
Coalesce Num Partitions: 5000 Num Hosts: 10 402 405 3 0.2 4017.3 0.7X
Coalesce Num Partitions: 5000 Num Hosts: 20 343 349 9 0.3 3429.4 0.8X
Coalesce Num Partitions: 5000 Num Hosts: 40 271 285 24 0.4 2713.2 1.1X
Coalesce Num Partitions: 5000 Num Hosts: 80 252 266 19 0.4 2519.9 1.1X
Coalesce Num Partitions: 10000 Num Hosts: 1 4867 4901 37 0.0 48665.7 0.1X
Coalesce Num Partitions: 10000 Num Hosts: 5 1178 1200 19 0.1 11783.9 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 10 688 702 17 0.1 6880.4 0.4X
Coalesce Num Partitions: 10000 Num Hosts: 20 501 513 18 0.2 5012.1 0.6X
Coalesce Num Partitions: 10000 Num Hosts: 40 364 369 6 0.3 3640.4 0.8X
Coalesce Num Partitions: 10000 Num Hosts: 80 293 306 11 0.3 2933.2 1.0X