Our Production Gateway Is Now Open Source

[vrushankportkey]

Dear Portkey community,

Two years ago, we built Portkey to be the fastest, most reliable path to production AI and open-sourced our AI Gateway.

A lot has changed since that first release. Hundreds of contributors, millions of users, and $15 Million in funding later, Portkey today processes 2 Trillion LLM tokens and over $1 Million in LLM spend every single day.

As we scaled and more customers went to production, we started maintaining a separate, internal version of the gateway. One where we could ship fixes and updates at the speed our enterprise customers needed. Over time, that created drift between our production gateway and the open source version.

Today, we're fixing that. Portkey's production gateway is merging into open source.

One gateway. One codebase. Maintained by the Portkey team and our open source contributors together.

This brings a lot of production-hardened updates to the OSS gateway:

Try out the pre-release here!