Litellm
litellm is an open-source AI gateway maintained by BerriAI, with a Rust core and Python SDK, that exposes over 100 LLM provider APIs (including AWS Bedrock, Azure, OpenAI, Anthropic, and VertexAI) behind a single OpenAI-compatible interface. It adds cost tracking, guardrails, and load balancing across providers. The project has been active since July 2023, carries roughly 56,500 stars and 4,933 open issues, and is distributed under a license GitHub lists as unassigned (NOASSERTION) rather than a standard SPDX identifier — worth checking before use in a context requiring a formally recognized license (see repository).
Placed in Tools / Trial.
Used as a gateway to switch between LLM models within AWS Bedrock, clearing the first-person use gate: litellm's OpenAI-compatible interface lets a Bedrock-backed pipeline change models without rewriting provider-specific request code.
Trial rather than Adopt: the confirmed use case is scoped to one integration (Bedrock model switching), not broad, reservation-free use across this project's work. The high open-issue count (nearly 5,000) is also worth tracking as a maturity signal before considering Adopt.
