Skip to content

🌌 one-api v2.0.0 β€” Universal Edge LLM Gateway

Latest

Choose a tag to compare

@shenald-dev shenald-dev released this 02 Nov 17:21
· 13 commits to master since this release
1dcaa12

🌌 one-api v2.0.0 β€” Universal Edge LLM Gateway

One API to rule them all. Unify OpenAI, Anthropic, Google Gemini, DeepSeek, Groq, Ollama, and more behind a high-performance OpenAI-compatible endpoint.

✨ What's New in v2.0

  • 20+ AI Providers Unified: Native translation for Anthropic Claude, OpenAI, Google Gemini, Groq, DeepSeek, Ollama, and Mistral.
  • OpenAI SDK Parity: Drop-in baseURL replacement for any standard OpenAI client, Cursor, LangChain, or OpenWebUI.
  • Server-Sent Events (SSE) Streaming: Instant real-time token streaming with sub-10ms edge latency.
  • Semantic In-Memory Caching: Sub-millisecond response times for repeated queries with zero token usage.
  • Docker & Edge Ready: Single-binary and Dockerized execution across Vercel Edge, Cloudflare Workers, and local servers.
  • 55/55 Passing Test Suite: Verified across unit, integration, and streaming protocol invariants.