Skip to content

[Installation]: How to install vLLM 0.11.0 with CUDA < 12.9 (Driver 535)? No matching wheels found #30633

Description

@whu125

Your current environment

I’m trying to install vLLM 0.11.0 on a machine with NVIDIA Driver 535, and I ran into issues related to CUDA version compatibility.

Environment

OS: Linux (Ubuntu 20.04 / 22.04)

GPU: NVIDIA GPU H20

NVIDIA Driver: 535.xx

Python: 3.10

vLLM version: 0.11.0

Problem

According to the release information for vLLM 0.11.0, the available prebuilt wheels appear to target CUDA 12.9+.
However, with Driver 535, CUDA 12.9 is not supported, and I cannot find any official wheels for CUDA 12.1 / 12.2 / 12.4 or lower.

This leads to the following questions:

Is vLLM 0.11.0 officially compatible with CUDA versions < 12.9?

If yes, what is the recommended way to install it on systems with Driver 535?

Build from source with a specific CUDA version?

Use a specific Docker image?

Pin to an older vLLM release?

Are there plans to provide prebuilt wheels for CUDA 12.1 / 12.4, or is CUDA 12.9+ now a hard requirement going forward?

What I’ve tried

Checked the GitHub Releases page for vLLM 0.11.0 — no wheels for CUDA < 12.9

Verified that upgrading CUDA to 12.9 is not possible with Driver 535

Looked for documentation on source builds for older CUDA versions, but didn’t find clear guidance

Any clarification or recommended workflow would be greatly appreciated.
Thanks in advance!

How you are installing vllm

pip install -vvv vllm

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.

Metadata

Metadata

Assignees

No one assigned

    Labels

    installationInstallation problemsstaleOver 90 days of inactivity

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions