🚀 The feature, motivation and pitch
Summary
vLLM fails to run on NVIDIA RTX 50-series GPUs (Blackwell, SM120/SM121) when installed from the prebuilt PyPI wheels (and/or official Docker images). The runtime crashes with errors like:
RuntimeError: CUDA error: no kernel image is available for execution on the device
- or
NVIDIA GeForce RTX 50xx with CUDA capability sm_120 is not compatible with the current PyTorch installation
This looks like the distributed binaries were built without Blackwell arch flags (SM120/SM121), even though the system meets the CUDA minimum for Blackwell.
Reproduction steps
- Create a clean environment
python -m venv .venv && source .venv/bin/activate
pip install -U pip
### Alternatives
_No response_
### Additional context
_No response_
### Before submitting a new issue...
- [x] Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the [documentation page](https://docs.vllm.ai/en/latest/), which can answer lots of frequently asked questions.
🚀 The feature, motivation and pitch
Summary
vLLM fails to run on NVIDIA RTX 50-series GPUs (Blackwell, SM120/SM121) when installed from the prebuilt PyPI wheels (and/or official Docker images). The runtime crashes with errors like:
RuntimeError: CUDA error: no kernel image is available for execution on the deviceNVIDIA GeForce RTX 50xx with CUDA capability sm_120 is not compatible with the current PyTorch installationThis looks like the distributed binaries were built without Blackwell arch flags (SM120/SM121), even though the system meets the CUDA minimum for Blackwell.
Reproduction steps