Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bugfix] [Hotfix] fix nccl library name #3661

Merged
merged 1 commit into from
Mar 27, 2024

Conversation

youkaichao
Copy link
Member

@youkaichao youkaichao commented Mar 27, 2024

Usually, the convention for dynamic shared library is: for nccl version 2.18.3, there would be a file libnccl.so.2.18.3, and the following files linked to that file:

  • libnccl.so.2.18
  • libnccl.so.2
  • libncclso.

This is often the case for system-installed nccl, e.g. our CI machine, in /usr/lib/x86_64-linux-gnu/libnccl.so .

However, the version pytorch installs, does not follow this convention. It is just named as s single file libnccl.so.2.

This PR will make pure pytorch users happy.

Copy link
Collaborator

@WoosukKwon WoosukKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Awesome! Thanks for the fix!

@youkaichao youkaichao enabled auto-merge (squash) March 27, 2024 17:06
@youkaichao youkaichao merged commit d18f4e7 into vllm-project:main Mar 27, 2024
32 of 33 checks passed
xjpang pushed a commit to xjpang/vllm that referenced this pull request Mar 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants