Home Page | Slack | Documentation

Collaborate on prompts, evaluate, and deploy LLM applications with confidence

The open-source LLM developer platform for prompt-engineering, evaluation, human feedback, and deployment of complex LLM apps.

---

Quick Start • Features • Documentation • Enterprise • Roadmap • Join Our Slack • Contributing

---

⭐️ Why Agenta?

Agenta is an end-to-end LLM developer platform. It provides the tools for prompt engineering and management, ⚖️ evaluation, human annotation, and 🚀 deployment. All without imposing any restrictions on your choice of framework, library, or model.

Agenta allows developers and product teams to collaborate in building production-grade LLM-powered applications in less time.

With Agenta, you can:

• 🧪 Experiment and compare prompts on any LLM workflow (chain-of-prompts, Retrieval Augmented Generation (RAG), LLM agents...)
• ✍️ Collect and annotate golden test sets for evaluation
• 📈 Evaluate your application with pre-existing or custom evaluators
• 🔍 Annotate and A/B test your applications with human feedback
• 🤝 Collaborate with product teams for prompt engineering and evaluation
• 🚀 Deploy your application in one-click in the UI, through CLI, or through github workflows.

Works with any LLM app workflow

Agenta enables prompt engineering and evaluation on any LLM app architecture:

• Chain of prompts
• RAG
• Agents
• ...

It works with any framework such as Langchain, LlamaIndex and any LLM provider (openAI, Cohere, Mistral).

Jump here to see how to use your own custom application with agenta

Quick Start

Get started for free

Explore the Docs

Create your first application in one-minute

Create an application using Langchain

Self-host agenta

Check the Cookbook

Features

Playground	Evaluation
Compare and version prompts for any LLM app, from single prompt to agents. playground_1024_30.07.2023.mp4	Define test sets, then evaluate manually or programmatically your different variants. new_eval_demo.mp4
Human annotation	Deployment
Use Human annotator to A/B test and score your LLM apps.	When you are ready, deploy your LLM applications as APIs in one click.

Enterprise Support

Contact us here for enterprise support and early access to agenta self-managed enterprise with Kubernetes support.

Disabling Anonymized Tracking

By default, Agenta automatically reports anonymized basic usage statistics. This helps us understand how Agenta is used and track its overall usage and growth. This data does not include any sensitive information.

To disable anonymized telemetry, follow these steps:

• For web: Set TELEMETRY_TRACKING_ENABLED to false in your agenta-web/.env file.
• For CLI: Set telemetry_tracking_enabled to false in your ~/.agenta/config.toml file.

After making this change, restart Agenta Compose.

Contributing

We warmly welcome contributions to Agenta. Feel free to submit issues, fork the repository, and send pull requests.

We are usually hanging in our Slack. Feel free to join our Slack and ask us anything

Check out our Contributing Guide for more information.

Contributors ✨

Thanks goes to these wonderful people (emoji key):

Sameh Methnani 💻 📖	Suad Suljovic 💻 🎨 🧑‍🏫 👀	burtenshaw 💻	Abram 💻 📖	Israel Abebe 🐛 🎨 💻	Master X 💻	corinthian 💻 🎨
Pavle Janjusevic 🚇	Kaosi Ezealigo 🐛 💻	Alberto Nunes 🐛	Maaz Bin Khawar 💻 👀 🧑‍🏫	Nehemiah Onyekachukwu Emmanuel 💻 💡 📖	Philip Okiokio 📖	Abhinav Pandey 💻
Ramchandra Warang 💻 🐛	Biswarghya Biswas 💻	Uddeepta Raaj Kashyap 💻	Nayeem Abdullah 💻	Kang Suhyun 💻	Yoon 💻	Kirthi Bagrecha Jain 💻
Navdeep 💻	Rhythm Sharma 💻	Osinachi Chukwujama 💻	莫尔索 📖	Agunbiade Adedeji 💻	Emmanuel Oloyede 💻 📖	Dhaneshwarguiyan 💻
Priyanshu Prajapati 📖	Raviteja 💻	Arijit 💻	Yachika9925 📖	Aldrin ⚠️	seungduk.kim.2304 💻	Andrei Dragomir 💻
diego 💻	brockWith 💻	Dennis Zelada 💻	Romain Brucker 💻	Heon Heo 💻	Drew Reisner 💻	Ikko Eltociear Ashimine 📖
Vishal Vanpariya 💻

This project follows the all-contributors specification. Contributions of any kind are welcome!

Attribution: Testing icons created by Freepik - Flaticon