-
Notifications
You must be signed in to change notification settings - Fork 28k
/
CoalescedRDDBenchmark-jdk17-results.txt
40 lines (37 loc) · 4.23 KB
/
CoalescedRDDBenchmark-jdk17-results.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
================================================================================================
Coalesced RDD , large scale
================================================================================================
OpenJDK 64-Bit Server VM 17.0.5+8 on Linux 5.15.0-1023-azure
Intel(R) Xeon(R) Platinum 8171M CPU @ 2.60GHz
Coalesced RDD: Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns) Relative
----------------------------------------------------------------------------------------------------------------------------
Coalesce Num Partitions: 100 Num Hosts: 1 298 348 64 0.3 2978.0 1.0X
Coalesce Num Partitions: 100 Num Hosts: 5 248 262 21 0.4 2483.7 1.2X
Coalesce Num Partitions: 100 Num Hosts: 10 266 284 22 0.4 2656.0 1.1X
Coalesce Num Partitions: 100 Num Hosts: 20 240 243 3 0.4 2404.1 1.2X
Coalesce Num Partitions: 100 Num Hosts: 40 267 273 6 0.4 2670.8 1.1X
Coalesce Num Partitions: 100 Num Hosts: 80 242 249 12 0.4 2424.5 1.2X
Coalesce Num Partitions: 500 Num Hosts: 1 593 594 2 0.2 5929.2 0.5X
Coalesce Num Partitions: 500 Num Hosts: 5 306 316 14 0.3 3063.3 1.0X
Coalesce Num Partitions: 500 Num Hosts: 10 295 302 6 0.3 2948.6 1.0X
Coalesce Num Partitions: 500 Num Hosts: 20 241 261 26 0.4 2406.6 1.2X
Coalesce Num Partitions: 500 Num Hosts: 40 258 260 4 0.4 2579.8 1.2X
Coalesce Num Partitions: 500 Num Hosts: 80 246 255 15 0.4 2456.2 1.2X
Coalesce Num Partitions: 1000 Num Hosts: 1 897 921 21 0.1 8966.6 0.3X
Coalesce Num Partitions: 1000 Num Hosts: 5 386 387 1 0.3 3860.9 0.8X
Coalesce Num Partitions: 1000 Num Hosts: 10 305 320 24 0.3 3045.2 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 20 271 283 17 0.4 2713.3 1.1X
Coalesce Num Partitions: 1000 Num Hosts: 40 293 296 4 0.3 2931.6 1.0X
Coalesce Num Partitions: 1000 Num Hosts: 80 251 254 3 0.4 2509.2 1.2X
Coalesce Num Partitions: 5000 Num Hosts: 1 3287 3304 22 0.0 32871.0 0.1X
Coalesce Num Partitions: 5000 Num Hosts: 5 879 885 7 0.1 8792.9 0.3X
Coalesce Num Partitions: 5000 Num Hosts: 10 597 599 3 0.2 5968.2 0.5X
Coalesce Num Partitions: 5000 Num Hosts: 20 402 416 16 0.2 4020.3 0.7X
Coalesce Num Partitions: 5000 Num Hosts: 40 315 323 8 0.3 3147.4 0.9X
Coalesce Num Partitions: 5000 Num Hosts: 80 271 281 13 0.4 2706.4 1.1X
Coalesce Num Partitions: 10000 Num Hosts: 1 6884 6902 17 0.0 68842.6 0.0X
Coalesce Num Partitions: 10000 Num Hosts: 5 1809 1844 59 0.1 18088.5 0.2X
Coalesce Num Partitions: 10000 Num Hosts: 10 1042 1057 20 0.1 10425.0 0.3X
Coalesce Num Partitions: 10000 Num Hosts: 20 622 637 13 0.2 6222.6 0.5X
Coalesce Num Partitions: 10000 Num Hosts: 40 468 473 5 0.2 4678.0 0.6X
Coalesce Num Partitions: 10000 Num Hosts: 80 352 360 7 0.3 3520.6 0.8X