🤖 The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Large Language Model Text Generation Inference

An open-source and enterprise-level monitoring system.

High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

Embrace the APIs of the future. Hug aims to make developing APIs as simple as possible, but no simpler.

Free, open-source SQL client for Windows and Mac 🦅

A familiar HTTP Service Framework for Python.

中文nlp解决方案(大模型、数据、模型、训练、推理)

A high-performance web server for Ruby, supporting HTTP/1, HTTP/2 and TLS.

LLM Finetuning with peft

A friendly library for parsing HTTP request arguments, with built-in support for popular web frameworks, including Flask, Django, Bottle, Tornado, Pyramid, webapp2, Falcon, and aiohttp.

🩹Editing large language models within 10 seconds⚡

🦙 Integrating LLMs into structured NLP pipelines

🤖 A PyTorch library of curated Transformer models and their composable components

The simplest way to serve AI/ML models in production

Secure 🔒 headers for Python web frameworks

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

a Python web framework generator supports Flask, Tornado, Falcon, Sanic