Jump-start your LLM project by starting from an app, not a framework. This repository aggregates high-quality, functioning web applications for use cases including Chatbots, Natural Language Interfaces, Assistants, and Question Answering Systems. It compares projects along important dimensions for these use cases, to help you choose the right starting point for your application.
To ensure the utmost quality and usability, projects must adhere to the following criteria to be included:
- Licensed under Open Source terms 💸
- Actively Maintained, meaning updated within the past month or under active monitoring 🚨
The projects span a wide range of complexity, from straightforward API wrappers to production-ready systems with multi-source RAG backends, conversation logging, and authentication/user management. There should be something for almost every need.
Contributions are the backbone of this list! If you're aware of a project that meets our criteria but isn't listed, we'd love to hear about it. Please also notify us if any of the listed projects becomes unmaintained or changes its licensing. Additionally, if there's a project detail that you'd like to compare that's not currently tracked, submit an issue for it. Finally, if you're the maintainer of a project that's already listed and would like to update or modify the listing, submit it again with the desired modifications.
To submit a project:
- Create an issue.
- Ensure your submission adheres to the listed criteria and includes all relevant details.
- Submissions will be reviewed and the projects list will be updated within a day.
If you'd like to help maintain this project, contact clharman via email.
Currently seeking submissions for:
- Lightweight chatbots
- Projects with advanced prompting
- Non-chatbot interfaces (question answering, etc)
- Projects with image support
- Projects in different languages e.g. Python only
| Project | Demo | Brief Description | Architecture | Conversation Context Carry | Conversation History | Authentication | Model Support | Rich Text Support | Image Support | (RAG) Search Engine | (RAG) Show Sources | (RAG) Data ingestion | Quick Deploy | Other Features |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Hugging Face Chat UI    |
🟢 Link | Full featured chat interface | SvelteKit, MongoDB | 🟢 | 🟢 | 🟢 OpenID | Hugging Face Inference API, local, Amazon SageMaker | 🟢 | 🔴 | 🟢 Google search | 🟢 | 🔴 | 🟢 Hugging Face Spaces | Theme configuration |
Weaviate Verba    |
🟢 Link | Chat interface for RAG applications | React frontend, FastAPI backend, Weaviate | 🔴 | 🔴 | 🔴 | OpenAI | 🟢 | 🔴 | 🟢 Weaviate | 🟢 | 🟢 Via CLI | 🟢 Docker | Semantic caching |
Microsoft Azure Chat    |
🔴 | Azure-based private chat tenant over data and files | Next.js, LangChain.js, CosmosDB | 🟢 | 🟢 | 🟢 NextAuth | OpenAI | 🟢 | 🔴 | 🟢 Azure Cognitive Search | 🔴 | 🟢 UI single-file upload | 🟢 Azure | |
AWS GenAI LLM Chatbot    |
🔴 | AWS-based chatbot with RAG and selectable LLMs | React frontend, LangChain.js, cloud services backend | 🟢 | 🟢 | 🟢 Amazon Cognito | Bedrock, SageMaker, Hugging Face Inference Endpoints, OpenAI, Anthropic, AI21, Cohere | 🔴 | 🔴 | 🟢 Postgres/ Kendra/ OpenSearch | 🟢 | 🟢 UI file upload | 🟢 AWS | User-selectable model and search backend |
PrivateGPT    |
🔴 | API, pipeline, and UI for RAG applications. Supports private models. | FastAPI, LlamaIndex, Gradio | 🟢 | 🔴 | 🔴 | Local, OpenAI, Sagemaker | 🔴 | 🔴 | 🟢 Qdrant, Chroma | 🟢 | 🟢 UI file upload | 🔴 | |
Ollama Web UI    |
🔴 | Full featured GPT clone | Sveltekit, Ollama backend | 🟢 | 🟢 | 🟢 | Local: Any Ollama supported model | 🟢 | 🟢 | 🔴 | 🔴 | 🔴 | 🟢 Docker Compose | |
Azure GPT-RAG    |
🔴 | Enterprise-ready RAG framework | All-Azure services | 🟢 | 🟢 | 🟢 Azure Active Directory | OpenAI | 🟢 | 🔴 | 🟢 Azure Cognitive Search | 🟢 | 🟢 Data source connections | 🟢 Azure | Microsoft Teams bot integration, costs estimator |
Danswer    |
🔴 | Full featured RAG system with prebuilt data connectors for many source systems | FastAPI, Next.js, Vespa, Postgres, Celery | 🟢 | 🟢 | 🟢 | OpenAI, Local | 🟢 | 🔴 | 🟢 Vespa | 🟢 | 🟢 Selection of data connectors | 🟢 Docker Compose, Kubernetes | Slack bot |
LLM Answer Engine    |
🔴 | Perplexity style answer engine with web search | React, LangChain.JS, Brave, Serper, OpenAI | 🟢 | 🔴 | 🔴 | Mixtral, Ollama, OpenAI | 🔴 | 🔴 | 🟢 Brave, Serper | 🟢 | 🔴 Web search, not ingestion | 🔴 | |
Dify    |
🔴 | App development platform for GenAI | Next.js, Flask, Postgres | 🟢 | 🟢 | 🟢 | Various | 🟢 | 🟢 | 🟢 Various | 🟢 | 🟢 UI file upload | 🟢 AWS, Kubernetes | Agents, observability |
Flowise    |
🔴 | Drag-and-drop LLM flow builder | React, Node | 🟢 | 🟢 | 🟢 | Various | 🔴 | 🔴 | 🟢 Various | 🟢 | 🟢 UI file upload | 🟢 AWS, Kubernetes | GUI/no-code LLM app logic builder |
RAGFlow    |
🟢 Link | Enterprise-RAG engine based on deep document understanding | React, DeepDoc | 🟢 | 🟢 | 🟢 | Various | 🟢 | 🟢 | 🟢 Elasticsearch/Infinity | 🟢 | 🟢 UI file upload / file management | 🟢 Docker Compose | Document structure recognition / Table structure recognition |
