v0.17.0
·
4553 commits
to vllm-for-windows
since this release
Experimental build of release v0.17.0 for Python 3.12, Cuda 12 and Pytorch 2.11 nightly
IMPORTANT: Due to Gloo distributed issue with Pytorch 2.8 to Pytorch 2.10, Pytorch 2.11 (nightly) is required.
This vLLM build has been done with Pytorch 2.11.dev20260216+cu126, you can install it with pip install vllm-0.17.0+cu124-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/nightly/cu126