Your current environment
I’m trying to install vLLM 0.11.0 on a machine with NVIDIA Driver 535, and I ran into issues related to CUDA version compatibility.
Environment
OS: Linux (Ubuntu 20.04 / 22.04)
GPU: NVIDIA GPU H20
NVIDIA Driver: 535.xx
Python: 3.10
vLLM version: 0.11.0
Problem
According to the release information for vLLM 0.11.0, the available prebuilt wheels appear to target CUDA 12.9+.
However, with Driver 535, CUDA 12.9 is not supported, and I cannot find any official wheels for CUDA 12.1 / 12.2 / 12.4 or lower.
This leads to the following questions:
Is vLLM 0.11.0 officially compatible with CUDA versions < 12.9?
If yes, what is the recommended way to install it on systems with Driver 535?
Build from source with a specific CUDA version?
Use a specific Docker image?
Pin to an older vLLM release?
Are there plans to provide prebuilt wheels for CUDA 12.1 / 12.4, or is CUDA 12.9+ now a hard requirement going forward?
What I’ve tried
Checked the GitHub Releases page for vLLM 0.11.0 — no wheels for CUDA < 12.9
Verified that upgrading CUDA to 12.9 is not possible with Driver 535
Looked for documentation on source builds for older CUDA versions, but didn’t find clear guidance
Any clarification or recommended workflow would be greatly appreciated.
Thanks in advance!
How you are installing vllm
Before submitting a new issue...
Your current environment
I’m trying to install vLLM 0.11.0 on a machine with NVIDIA Driver 535, and I ran into issues related to CUDA version compatibility.
Environment
OS: Linux (Ubuntu 20.04 / 22.04)
GPU: NVIDIA GPU H20
NVIDIA Driver: 535.xx
Python: 3.10
vLLM version: 0.11.0
Problem
According to the release information for vLLM 0.11.0, the available prebuilt wheels appear to target CUDA 12.9+.
However, with Driver 535, CUDA 12.9 is not supported, and I cannot find any official wheels for CUDA 12.1 / 12.2 / 12.4 or lower.
This leads to the following questions:
Is vLLM 0.11.0 officially compatible with CUDA versions < 12.9?
If yes, what is the recommended way to install it on systems with Driver 535?
Build from source with a specific CUDA version?
Use a specific Docker image?
Pin to an older vLLM release?
Are there plans to provide prebuilt wheels for CUDA 12.1 / 12.4, or is CUDA 12.9+ now a hard requirement going forward?
What I’ve tried
Checked the GitHub Releases page for vLLM 0.11.0 — no wheels for CUDA < 12.9
Verified that upgrading CUDA to 12.9 is not possible with Driver 535
Looked for documentation on source builds for older CUDA versions, but didn’t find clear guidance
Any clarification or recommended workflow would be greatly appreciated.
Thanks in advance!
How you are installing vllm
Before submitting a new issue...