Skip to content

v0.25.0

Choose a tag to compare

View all tags
@SystemPanic SystemPanic released this 12 Jul 19:40
· 520 commits to vllm-for-windows since this release
v0.25.0
43f83ae

Windows build of release v0.25.0 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.25.0+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13.

This wheel is built for Ampere (RTX 30XX) + ADA (RTX 40XX / PRO) + Blackwell (RTX 50XX / PRO).

  • NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows.

  • DeepSeek v4 DeepGEMM kernels inference support on Windows. Install with git clone -b deepgemm-nv-dev-windows --single-branch --recursive --shallow-submodules https://github.com/SystemPanic/DeepGEMM-windows.git & cd DeepGEMM-windows & pip install .

Star the repo, give a like and share the announcement on LinkedIn or share on Reddit to help support the project.

Assets 3
Loading