-
Notifications
You must be signed in to change notification settings - Fork 934
btl openib: only initialize CPCs if there are devices to use #555
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
f4e5ca6 to
3195214
Compare
|
|
Refer to this link for build results (access rights to CI server needed): |
|
@hjelmn reviewed this and gave me an "ok" in IM. He says that Jenkins explicitly tests openib, so it should have failed if I broke something. I think @hppritcha is going to specifically test this, though, so I'll wait for his ok before merging it in. |
Defer initializing the CPCs until we know that we have devices/ports to use. This both prevents some useless work at startup when there are no devices/ports to use, and also prevents librdmacm complaining that there are no verbs-capable RDMA devices available (e.g., if a Cisco usNIC device is present, but does not present a verbs RDMA interface).
3195214 to
202f648
Compare
|
@hjelmn @hppritcha I would like to merge in #565, and it depends on this PR. Can you please review / test? Thanks. |
|
|
Refer to this link for build results (access rights to CI server needed): |
|
This worked for me on one of the mlnx clusters here. |
btl openib: only initialize CPCs if there are devices to use
Add config code to check for need of workaround. Add runtime way to turn off just in case.
Selective sync with upstream Open MPI
Defer initializing the CPCs until we know that we have devices/ports to use. This both prevents some useless work at startup when there are no devices/ports to use, and also prevents librdmacm from complaining that there are no verbs-capable RDMA devices available (e.g., if a Cisco usNIC device is present, but does not present a verbs RDMA interface).
@hjelmn Can you please confirm that I didn't break anything?