Call many AIs from a single API.
-
Updated
Mar 28, 2024 - Go
#
vllm
Here are 2 public repositories matching this topic...
🔒 Enterprise-grade API gateway that helps you monitor and impose cost or rate limits per API key. Get fine-grained access control and monitoring per user, application, or environment. Supports OpenAI, Azure OpenAI, Anthropic, vLLM, and open-source LLMs.
api
docker
golang
open-source
security
privacy
ai
azure
rest-api
postgresql
self-hosted
artificial-intelligence
ycombinator
openai
gpt
llm
generative-ai
anthropic
vllm
-
Updated
Jun 6, 2024 - Go
Improve this page
Add a description, image, and links to the vllm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the vllm topic, visit your repo's landing page and select "manage topics."