Skip to content

fix(docker): add AWS EFA/OFI library paths to LD_LIBRARY_PATH#2359

Closed
kajalj22 wants to merge 1 commit into
mainfrom
fix/aws-efa-ld-library-path
Closed

fix(docker): add AWS EFA/OFI library paths to LD_LIBRARY_PATH#2359
kajalj22 wants to merge 1 commit into
mainfrom
fix/aws-efa-ld-library-path

Conversation

@kajalj22

@kajalj22 kajalj22 commented Apr 28, 2026

Copy link
Copy Markdown
Contributor

Summary

  • Add /opt/amazon/aws-ofi-nccl/lib and /opt/amazon/efa/lib to LD_LIBRARY_PATH in the Dockerfile so NCCL can discover the OFI plugin and use EFA transport on AWS instances (P5en, P4d)
  • Without this, NCCL falls back to Socket transport even though the plugin libraries are present in the container

🤖 Generated with Claude Code

NCCL cannot discover the OFI plugin (libnccl-net-aws-ofi.so) because
/opt/amazon/aws-ofi-nccl/lib and /opt/amazon/efa/lib are not on the
library search path, causing fallback to Socket transport on EFA-enabled
instances (P5en, P4d).

Closes #1973

Signed-off-by: Kajal Jain <kajalj@nvidia.com>
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Signed-off-by: Kajal Jain <kajalj@nvidia.com>
@kajalj22 kajalj22 requested a review from a team as a code owner April 28, 2026 22:22
@copy-pr-bot

copy-pr-bot Bot commented Apr 28, 2026

Copy link
Copy Markdown

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@kajalj22

Copy link
Copy Markdown
Contributor Author

/ok to test c2327fc

@kajalj22 kajalj22 added the CI:L1 Run doctests, unit tests, and functional tests label Apr 28, 2026
@kajalj22 kajalj22 requested a review from a team April 28, 2026 22:51
@kajalj22 kajalj22 closed this Apr 28, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CI:L1 Run doctests, unit tests, and functional tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant