Skip to content

lvllm-v2.3.8

Choose a tag to compare

@guqiong96 guqiong96 released this 27 Jul 06:57
· 596 commits to main since this release

Merge upstream vllm tag 'v0.26.0'

Docker:
https://hub.docker.com/u/garenleeasa 
Note: Add --privileged to the container run command, which grants full access including NUMA topology visibility and SYS_NICE capability in one shot.