A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Test your prompts, models, and RAGs. Catch regressions and improve prompt quality. LLM evals for OpenAI, Azure, Anthropic, Gemini, Mistral, Llama, Bedrock, Ollama, and other local & private models with CI/CD integration.

Turn expensive prompts into cheap fine-tuned models

An open-source visual programming environment for battle-testing prompts to LLMs.

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

LLM Prompt Injection Detector

📊 llm.report is an open-source logging and analytics platform for OpenAI: Log your ChatGPT API requests, analyze costs, and improve your prompts.

Smoothly Manage Multiple LLMs (OpenAI, Anthropic, Azure) and Image Models (Dall-E, SDXL), Speed Up Responses, and Ensure Non-Stop Reliability.

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

Framework to bring LLM applications to production

Test and evaluate LLMs, prompts and other configuration, across all the scenarios that matter for your application

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

Multi-Agent Conversation Framework in TypeScript

Integrating AI into every workflow with our open-source, no-code platform, powered by the actor model for dynamic, graph-based solutions.

A private and secure generative AI tool, based on GPT-4 and deployed for non-clinical use at Dana-Farber Cancer Institute

npm like package ecosystem for Prompts 🤖

agentcraft 可以帮助您快速构建各类应用场景的ai agent应用

Promptdesk is a tool designed for effectively creating, organizing, and evaluating prompts and large language models (LLMs).

Collaborative prompt & model engineering for LLM product teams