Open-source Rust/Pingora AI gateway and reverse proxy for self-hosted LLM traffic control: OpenAI-compatible Chat/Responses, provider routing/fallback, virtual API keys, policy and budgets, exact-match cache, MCP/tool execution, observability, Admin APIs/dashboard, cluster ops, and automatic HTTPS.
infrastructure rust ai api-gateway reverse-proxy ai-tools ai-agent ai-gateway aigateway mcp-gateway agentic-gateway
-
Updated
Jul 1, 2026 - Rust