Skip to content

LLMProxy v0.1.0

Choose a tag to compare

View all tags
@github-actions github-actions released this 24 Sep 01:09
· 43 commits to main since this release
v0.1.0
9a9773e

LLMProxy v0.1.0 is the initial MIT-licensed, self-hosted LLM gateway built with C# and .NET 10.

  • OpenAI-compatible chat completions, model listing, function tools and SSE streaming.
  • OpenAI, Anthropic, Google Gemini and Azure OpenAI adapters with configurable model aliases, routing, retries and fallback.
  • Hashed gateway API keys, distributed rate limits, token and spending allowances, durable usage and estimated cost tracking.
  • PostgreSQL and Redis deployment, persistent standalone mode, health checks, OpenTelemetry and graceful shutdown.
  • Non-root Docker images for Linux amd64 and arm64, Docker Compose, API documentation and Python, TypeScript and C# client examples.

Validation: 87 automated tests, plus Docker deployment and OpenAI SDK smoke tests. Automated inference requests use local mock providers; Docker runtime checks execute on amd64.

Images: ghcr.io/mo7ammedd/llmproxy:v0.1.0, v0.1 and latest.

The repository and container package are private. Authenticate to GHCR before pulling. Follow the deployment guide to configure credentials and create a gateway key.

This MVP supports text and function tools with one completion choice. Multimodal requests and the Responses API are outside this release. See the API compatibility documentation for the full supported surface and provider differences.

Assets 2
Loading