-
Notifications
You must be signed in to change notification settings - Fork 931
Add new PSM2 MTL. #650
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add new PSM2 MTL. #650
Conversation
This new MTL runs over PSM2 for Omni Path. PSM2 is a descendant of PSM with changes to support more ranks and some MPI-3 features like mprobe. PSM2 will only support Omni Path networks; PSM only supports True Scale. Likewise, the existing PSM MTL will continue to be maintained for True Scale, while the PSM2 MTL is developed and maintained for Omni Path.
|
Refer to this link for build results (access rights to CI server needed): Build Log |
|
@miked-mellanox We keep seeing this failure recently - is it bogus? |
|
the failure seems unrelated to your commit but real. it seems that ob1 and sm have issues with threading support. @hjelmn - could you please take a look? |
|
I"m not sure for the 1.10.x that we are claiming support for mpi thread multiple for ob1. |
|
ob1 is thread safe but not all of the btls are. I know vader is thread safe but have no idea if sm is. It might be close to time to put btl/sm out to pasture. |
|
cool, thanks |
|
Refer to this link for build results (access rights to CI server needed): |
|
Refer to this link for build results (access rights to CI server needed): |
|
Is it OK for me to hit the merge button, or should one of the core developers do it? Anything else that I need to address? |
|
Go for it 😀 Sent from my iPhone
|
HCOLL: Enable alltoall interface
This new MTL supports PSM2 for Omni Path. PSM2 is a descendant of PSM
with changes to support more processes and some MPI-3 features like mprobe.
PSM2 will only support Omni Path networks; PSM only supports True Scale.
Likewise, the existing PSM MTL will continue to be maintained for True
Scale, while the PSM2 MTL is developed and maintained for Omni Path.