☁️ Build multimodal AI applications with cloud-native stack

A high-throughput and memory-efficient inference and serving engine for LLMs

<⚡️> SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

RAGFlow is an open-source RAG (Retrieval-Augmented Generation) engine based on deep document understanding.

The most flexible way to serve AI/ML models in production - Build Model Inference Service, LLM APIs, Inference Graph/Pipelines, Compound AI systems, Multi-Modal, RAG as a Service, and more!

Memory, knowledge and tools for LLMs

Evaluation framework for your Retrieval Augmented Generation (RAG) pipelines

🔮 SuperDuperDB: Bring AI to your database! Build, deploy and manage any AI application directly with your existing data infrastructure, without moving your data. Including streaming inference, scalable model training and vector search.

ZenML 🙏: Build portable, production-ready MLOps pipelines. https://zenml.io.

🐢 Open-Source Evaluation & Testing framework for LLMs and ML models

LLM App templates for RAG, knowledge mining, and stream analytics. Ready to run with Docker,⚡in sync with your data sources.

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

🤖Self-Modifying Framework from the Future 🔮 World's First AMS

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

Open-source observability for your LLM application, based on OpenTelemetry

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

RayLLM - LLMs on Ray