🪢 Open source LLM engineering platform: Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

ClickPrompt - Streamline your prompt design, with ClickPrompt, you can easily view, share, and run these prompts with just one click. ClickPrompt 用于一键轻松查看、分享和执行您的 Prompt。

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

An open-source visual programming environment for battle-testing prompts to LLMs.

Turn expensive prompts into cheap fine-tuned models

Magick is a cutting-edge toolkit for a new kind of AI builder. Make Magick with us!

Fast ChatGPT UI with support for both OpenAI and Azure OpenAI. 快速的ChatGPT UI，支持OpenAI和Azure OpenAI。

ChatDev IDE is an tools for building your ai agent, Whether it's NPCs in games or powerful agent tools, you can design what you want for this platform.

LLM Prompt Injection Detector

LangChain LLM application. Dynamic metaprompting for theory-of-mind-powered tutoring.

Framework to bring LLM applications to production

Social and customizable AI writing assistant! ✍️

Latent web browser

Generative AI Scripting

npm like package ecosystem for Prompts 🤖

Langtrace 🔍 is an open-source, Open Telemetry based end-to-end observability tool for LLM applications, providing real-time tracing, evaluations and metrics for popular LLMs, LLM frameworks, vectorDBs and more.. Integrate using Typescript, Python. 🚀💻📊

Generate and publish your content from the command line with the help of AI (GPT) 🤯

Prompt Engineering Research Tool for AI APIs

🤖 A prompt manager for MacOS built with Tauri ♉️