#

vllm

Here are 2 public repositories matching this topic...

ivangabriele / docker-functionary

Ready-to-deploy Docker image for Functionary LLM served as an OpenAI-Compatible API.

docker ai server functions docker-image openai docker-hub openai-api large-language-models llm vllm llama2 functionary

Updated May 26, 2024
Dockerfile

ivangabriele / docker-llm

Pre-loaded LLMs served as an OpenAI-Compatible API via Docker images.

api docker server docker-image openai vast orca vicuna openai-api llm runpod llms vllm lmsys openorca llong

Updated Oct 31, 2023
Dockerfile

Improve this page

Add a description, image, and links to the vllm topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the vllm topic, visit your repo's landing page and select "manage topics."