🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

AI模型接口管理与分发系统，支持将多种大模型转为OpenAI格式调用、支持Midjourney Proxy、Suno、Rerank，兼容易支付协议，可供个人或者企业内部管理与分发渠道使用，本项目基于One API二次开发。🍥 The next-generation LLM gateway and AI asset management system supports multiple languages.

llama.cpp (GGUF LLMs) and llava.cpp (GGUF VLMs) for ROS 2

gpt_server是一个用于生产级部署LLMs或Embedding的开源框架。

rerank library for easy reranking of results

A BM25 Java implementation using streams, stop words and stemming.

SearchAugmentedLLM empowers LLMs with information from the web

Automated fact-check

Rapid Deployment of LLM and Embedding Based on VLLM Using Docker

A comprehensive RAG FastAPI service that handles document uploads and retrievals, built with Python. Uses PyMuPDF for document processing, turbopuffer for vector storage, OpenAI for models, and cohere for reranking.

Develop an nlp-based method to predict the affinity between misconceptions and incorrect answers (distractors) in multiple-choice questions.

Retrieval and Retrieval-augmented LLMs