Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Minor Fix] Use cupy-cuda11x in CUDA 11.8 build #3256

Merged
merged 1 commit into from
Mar 13, 2024

Conversation

chenxu2048
Copy link
Contributor

The packages for CUDA 11.8 depend on cupy-cuda12x instead cupy-cuda11x (#3107). Here is a minor fix for it.

cupy-cuda12x == 12.1.0  # Required for CUDA graphs. CUDA 11.8 users should install cupy-cuda11x instead.

We don't know which version of cupy-cuda11x is required. Thus just let pip decides it.

@WoosukKwon
Copy link
Collaborator

@bnellnm Is it ok to merge this PR? I'm asking since this PR touches setup.py.

@bnellnm
Copy link
Contributor

bnellnm commented Mar 13, 2024

@bnellnm Is it ok to merge this PR? I'm asking since this PR touches setup.py.

@WoosukKwon Yeah, this is fine. I can merge in the changes easily.

Copy link
Collaborator

@WoosukKwon WoosukKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@chenxu2048 Thanks for the fix!

@WoosukKwon WoosukKwon merged commit 739c350 into vllm-project:main Mar 13, 2024
23 checks passed
@chenxu2048 chenxu2048 deleted the cu118-cupy-cuda11x branch March 14, 2024 02:00
starmpcc pushed a commit to starmpcc/vllm that referenced this pull request Mar 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants