-
-
Notifications
You must be signed in to change notification settings - Fork 9.2k
Closed
Labels
usageHow to use vllmHow to use vllm
Description
Your current environment
‘latest’ tag is missing from https://gallery.ecr.aws/q9t5s3a7/vllm-cpu-release-repo, which requires having to keep changing the image manually on every release.
we expect the CI/CD not only to create a versioned tag, but also to tag latest once a new release is out.
How would you like to use vllm
I want to run inference
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
Metadata
Metadata
Assignees
Labels
usageHow to use vllmHow to use vllm