Kaeso: an open-source, self-hosted AI gateway with SSO, budgets and a real console

[dvnold]

Introduce yourself

Hi everyone,

I’m Devin, a student from Germany who spends most of his time building things. I wanted to introduce myself and share the project I’ve been working on for the past few months: Kaeso, an open-source AI gateway you run on your own infrastructure.

Kaeso sits between your apps and your model providers. Your team gets one endpoint, one place for keys and one console to see what’s happening. I started it because the gateways I tried felt powerful but painful to operate. I wanted something fast, secure by default and pleasant to use every day.

What Kaeso does today (v0.3.8)

• Single sign-on done properly. OIDC SSO restricted to DNS-verified domains, accounts linked to your organization’s identity provider, two-factor authentication and audit logs. SSO can also be the only way in.
• Fast under load. The core is written in Rust. Provider lookups, streams and limit checks don’t queue behind large or busy connections.
• Any app format, any model. OpenAI Chat Completions, OpenAI Responses and Anthropic Messages endpoints, with streaming. Each request is translated, so an app built for one API can call models from another.
• Built-in providers. OpenAI, Anthropic, DeepSeek, xAI, Mistral, Groq, Together AI and OpenRouter. You add a key and you’re set.
• Budgets that hold. Rate, token and spend limits per project, which stay accurate even with many concurrent requests and long streams.
• Request logs. Metadata for every request, plus optional full content in ClickHouse, with filtering and export.
• A console your team will actually use. A web UI in English, German and Simplified Chinese for keys, projects, members and logs.
• One-click updates. Self-hosted installs check for new releases, and an optional updater applies them after verifying build provenance. It rolls back automatically if the new version fails to start.
• MIT licensed. Fully open source.

Getting started

• Repository: https://github.com/logicplanes/kaeso
• Documentation: https://docs.kaeso.app/
• Release notes: https://update.kaeso.app/

What I’d love from you

Kaeso is moving fast, with nine releases in the last week alone, and feedback shapes what comes next. If you run AI features in production, I’d really like to hear:

• What frustrates you about the gateway or proxy you use today?
• Which feature would make you switch?

Issues, discussions and stars on the repo are all hugely appreciated. Thanks for reading!

Links (optional)

This is my blog: https://devinoldenburg.com

Where are you in your GitHub journey?

Maintaining a project or repo owner

And where are you going next on GitHub?

I want to build great products that help people, and in the long term I want to help move the technological state of the human race in a positive direction. Whether through my own company or through a job, this is my goal as a human being.

What technical skills or projects are you working on?

I’m building Kaeso, an open-source AI gateway written in Rust that lets teams route requests to any model provider through one secure, self-hosted endpoint. Beyond that, I run Logicplanes, my umbrella for projects like Kaeso, and I spend most days learning new things in software, AI and infrastructure.

Got a question for us? (optional)

No response

[v-ember]

Hi @dvnold, thanks for sharing with the community!

Unfortunately, we currently do not allow self-promotion, advertising, or solicitation in Community Discussions. We want to make sure there is space for users to ask questions without overwhelming them with other conversations. Thank you for helping us maintain a productive and tidy community for all our members.