Skip to content

v0.16.0

Choose a tag to compare

View all tags
@SystemPanic SystemPanic released this 18 Feb 00:17
· 5219 commits to vllm-for-windows since this release
v0.16.0
df8fd09
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

Experimental build of release v0.16.0 for Python 3.12, Cuda 12 and Pytorch 2.11 nightly

IMPORTANT: Due to Gloo distributed issue with Pytorch 2.8 to Pytorch 2.10, Pytorch 2.11 (nightly) is required.

This vLLM build has been done with Pytorch 2.11.dev20260216+cu126, you can install it with pip install vllm-0.16.0+cu124-cp312-cp312-win_amd64.whl --extra-index-url https://download.pytorch.org/whl/nightly/cu126

Assets 3
Loading