This repo shows how to run vLLM on Azure Machine Learning for out-of-the-box models from HuggingFace or fine-tuned/customized models.
Full tutorial can be found here.
-
Notifications
You must be signed in to change notification settings - Fork 4
csiebler/vllm-on-azure-machine-learning
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
This repo shows how to run vLLM on Azure Machine Learning for pre-trained or fine-tuned models
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published