Skip to content

This repo shows how to run vLLM on Azure Machine Learning for pre-trained or fine-tuned models

Notifications You must be signed in to change notification settings

csiebler/vllm-on-azure-machine-learning

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 

Repository files navigation

vllm-on-azure-machine-learning

This repo shows how to run vLLM on Azure Machine Learning for out-of-the-box models from HuggingFace or fine-tuned/customized models.

Full tutorial can be found here.

About

This repo shows how to run vLLM on Azure Machine Learning for pre-trained or fine-tuned models

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published