Skip to content

Releases: SystemPanic/vllm-windows

v0.26.0

Choose a tag to compare

@SystemPanic SystemPanic released this 28 Jul 20:53

Windows build of release v0.26.0 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.26.0+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13.

This wheel is built for Ampere (RTX 30XX) + ADA (RTX 40XX / PRO) + Blackwell (RTX 50XX / PRO).

  • NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows.

  • DeepSeek v4 DeepGEMM kernels inference support on Windows. Install with git clone -b deepgemm-nv-dev-windows --single-branch --recursive --shallow-submodules https://github.com/SystemPanic/DeepGEMM-windows.git & cd DeepGEMM-windows & pip install .

Star the repo, give a like and share the announcement on LinkedIn or share on Reddit to help support the project.

v0.25.0

Choose a tag to compare

@SystemPanic SystemPanic released this 12 Jul 19:40

Windows build of release v0.25.0 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.25.0+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13.

This wheel is built for Ampere (RTX 30XX) + ADA (RTX 40XX / PRO) + Blackwell (RTX 50XX / PRO).

  • NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows.

  • DeepSeek v4 DeepGEMM kernels inference support on Windows. Install with git clone -b deepgemm-nv-dev-windows --single-branch --recursive --shallow-submodules https://github.com/SystemPanic/DeepGEMM-windows.git & cd DeepGEMM-windows & pip install .

Star the repo, give a like and share the announcement on LinkedIn or share on Reddit to help support the project.

v0.24.0

Choose a tag to compare

@SystemPanic SystemPanic released this 03 Jul 02:13

Windows build of release v0.24.0 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.24.0+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13 to use the wheel.

  • The default wheel is built for Ampere (RTX 3090 / Ti) + ADA (RTX 4090) + Blackwell (RTX 5090 / 6000 PRO) support.

  • NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows.

Star the repo, give a like and share the announcement on LinkedIn or share on Reddit to help support the project.

v0.23.0

Choose a tag to compare

@SystemPanic SystemPanic released this 15 Jun 22:06

Windows build of release v0.23.0 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.23.0+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13 to use the wheel.

  • The default wheel is built for Ampere (RTX 3090 / Ti) + ADA (RTX 4090) + Blackwell (RTX 5090 / 6000 PRO) support.

  • NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows (experimental).

Like and share the announcement on LinkedIn or Reddit to help support the project.

v0.22.1

Choose a tag to compare

@SystemPanic SystemPanic released this 07 Jun 14:59

Windows build of release v0.22.1 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.22.1+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13 to use the wheel.

  • The default wheel is built for Ampere (RTX 3090 / Ti) + ADA (RTX 4090) + Blackwell (RTX 5090 / 6000 PRO) support.

  • NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows (experimental).

Like and share the announcement on LinkedIn or Reddit to help support the project.

v0.21.0

Choose a tag to compare

@SystemPanic SystemPanic released this 16 May 00:48

Windows build of release v0.21.0 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.21.0+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13 to use the wheel.

  • The default wheel is built for Ampere (RTX 3090 / Ti) + ADA (RTX 4090) + Blackwell (RTX 5090 / 6000 PRO) support.

  • This is the first release with NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows (experimental).

Like and share the announcement on LinkedIn or Reddit to help support the project.

v0.20.0

Choose a tag to compare

@SystemPanic SystemPanic released this 30 Apr 19:19

Windows build of release v0.20.0 for Python 3.12, CUDA 13 and Pytorch 2.11

Install the wheel with pip install vllm-0.20.0+cu132-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/cu130

IMPORTANT

You need CUDA 13 to use the wheel.

  • The default wheel is built for Ampere (RTX 3090 / Ti) + ADA (RTX 4090) + Blackwell (RTX 5090 / 6000 PRO) support.

  • This is the first release with NCCL + Tensor / Pipeline parallelism for multi-gpu inference support on Windows (experimental).

Like and share the announcement on LinkedIn or Reddit to help support the project.

v0.19.0

Choose a tag to compare

@SystemPanic SystemPanic released this 04 Apr 04:01

Windows build of release v0.19.0 for Python 3.12, Cuda 12.4 and Pytorch 2.11

IMPORTANT: Due to Gloo distributed issue with Pytorch 2.8 to Pytorch 2.10, Pytorch 2.11 is required.

Install the wheel with pip install vllm-0.19.0+cu124-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/nightly/cu126

v0.17.0

Choose a tag to compare

@SystemPanic SystemPanic released this 12 Mar 02:32

Experimental build of release v0.17.0 for Python 3.12, Cuda 12 and Pytorch 2.11 nightly

IMPORTANT: Due to Gloo distributed issue with Pytorch 2.8 to Pytorch 2.10, Pytorch 2.11 (nightly) is required.

This vLLM build has been done with Pytorch 2.11.dev20260216+cu126, you can install it with pip install vllm-0.17.0+cu124-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/nightly/cu126

v0.16.0

Choose a tag to compare

@SystemPanic SystemPanic released this 18 Feb 00:17
df8fd09

Experimental build of release v0.16.0 for Python 3.12, Cuda 12 and Pytorch 2.11 nightly

IMPORTANT: Due to Gloo distributed issue with Pytorch 2.8 to Pytorch 2.10, Pytorch 2.11 (nightly) is required.

This vLLM build has been done with Pytorch 2.11.dev20260216+cu126, you can install it with pip install vllm-0.16.0+cu124-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/nightly/cu126