lvllm-v2.3.8
Merge upstream vllm tag 'v0.26.0'
Docker:
https://hub.docker.com/u/garenleeasa
Note: Add --privileged to the container run command, which grants full access including NUMA topology visibility and SYS_NICE capability in one shot.
Merge upstream vllm tag 'v0.26.0'
Docker:
https://hub.docker.com/u/garenleeasa
Note: Add --privileged to the container run command, which grants full access including NUMA topology visibility and SYS_NICE capability in one shot.