Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

coll/basic: mca_coll_basic_gatherv_intra root posts irecv #12305

Merged
merged 1 commit into from
Mar 13, 2024

Conversation

wenduwan
Copy link
Contributor

@wenduwan wenduwan commented Feb 4, 2024

Match mca_coll_basic_gatherv_inter and post recvs all at once and wait for completion.

On 16 nodes x 64 procs per node.

Before change

# OSU MPI Gatherv Latency Test v7.2
# Datatype: MPI_CHAR.
# Size       Avg Latency(us)   Min Latency(us)   Max Latency(us)  Iterations
1                       4.70              0.44           1536.99        1000
2                       4.55              0.44           1349.49        1000
4                       4.55              0.44           1354.38        1000
8                       4.57              0.43           1355.60        1000
16                      4.54              0.43           1358.09        1000
32                      4.57              0.43           1367.16        1000
64                      4.65              0.51           1401.43        1000
128                     4.71              0.51           1435.00        1000
256                     6.67              0.54           1481.32        1000
512                     6.79              0.62           1506.00        1000
1024                    7.07              0.75           1636.05        1000
2048                    7.58              1.02           1885.09        1000
4096                  176.95              1.34           2374.75        1000
8192                  334.70             42.01           3105.94        1000
16384                 675.91             48.24           5991.97         100
32768                1398.70             49.25          11533.55         100
65536                2796.40             56.01          22327.21         100
131072              28857.40            126.02          58478.83         100
262144              39252.54            143.59          79549.07         100
524288              74975.66            154.49         153863.74         100

After change

# OSU MPI Gatherv Latency Test v7.2
# Datatype: MPI_CHAR.
# Size       Avg Latency(us)   Min Latency(us)   Max Latency(us)  Iterations
1                       4.07              0.43            837.03        1000
2                       4.12              0.43            855.29        1000
4                       4.12              0.40            867.89        1000
8                       4.13              0.41            871.72        1000
16                      4.11              0.41            867.32        1000
32                      4.12              0.31            868.77        1000
64                      4.19              0.49            890.67        1000
128                     4.23              0.39            904.01        1000
256                     5.81              0.53            922.80        1000
512                     5.93              0.60            951.96        1000
1024                    6.15              0.73           1038.52        1000
2048                    6.58              0.99           1181.65        1000
4096                  175.48              1.41           1485.15        1000
8192                  337.08             40.62           1980.23        1000
16384                 695.01             47.09           3501.86         100
32768                1366.80             50.47           6609.68         100
65536                2806.96             55.93          12364.52         100
131072               7446.11            289.31          23053.06         100
262144              22079.03            316.72          44473.66         100
524288              57385.71            401.17          86912.28         100

@wenduwan wenduwan requested a review from bosilca February 4, 2024 04:28
@wenduwan wenduwan force-pushed the gatherv_irecv branch 4 times, most recently from 0b477b3 to 61a3692 Compare February 4, 2024 04:56
@wenduwan wenduwan self-assigned this Feb 5, 2024
Match mca_coll_basic_gatherv_inter and post recvs all at once
and wait for completion.

Signed-off-by: Wenduo Wang <wenduwan@amazon.com>
@wenduwan wenduwan requested a review from devreal March 13, 2024 18:39
@wenduwan wenduwan merged commit 9fc7ee4 into open-mpi:main Mar 13, 2024
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants