Open Source LLM proxy that transparently captures and logs all interactions with LLM API

This is a robust and configurable LLM proxy server built with Node.js, Express, and PostgreSQL. It acts as an intermediary between your applications and various Large Language Model (LLM) providers

A personal LLM gateway with fault-tolerant capabilities for calls to LLM models from any provider with OpenAI-compatible APIs. Advanced features like retry, model sequencing, and body parameter injection are also available. Especially useful to work with AI coders like Cline and RooCode and providers like OpenRouter.

Proxy for many LLM-provider with OpenAI like request

Store your knowledge (privately), lead LLMs with it and cure hallucinations.

Sorai is a lightweight, high-performance, and open-source LLM proxy gateway.