Skip to content

v0.22.1

Choose a tag to compare

View all tags
@SystemPanic SystemPanic released this 07 Jun 14:59
v0.22.1
6e31fde

Windows build of release v0.22.1 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.22.1+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13 to use the wheel.

  • The default wheel is built for Ampere (RTX 3090 / Ti) + ADA (RTX 4090) + Blackwell (RTX 5090 / 6000 PRO) support.

  • NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows (experimental).

Like and share the announcement on LinkedIn or Reddit to help support the project.

Assets 3
Loading