MLX: An array framework for Apple silicon

Examples in the MLX framework

Tools for merging pretrained large language models.

Lightweight inference library for ONNX files, written in C++. It can run Stable Diffusion XL 1.0 on a RPI Zero 2 (or in 298MB of RAM) but also Mistral 7B on desktops and servers. ARM, x86, WASM, RI…

LlamaIndex is the leading document agent and OCR platform

Data framework for your LLM applications. Focus on server side solution

Grok open release

Zero-Shot Speech Editing and Text-to-Speech in the Wild

Instant voice cloning by MIT and MyShell. Audio foundation model.

A single Gradio + React WebUI with extensions for ACE-Step, Kimi Audio, Piper TTS, GPT-SoVITS, CosyVoice, XTTSv2, DIA, Kokoro, OpenVoice, ParlerTTS, Stable Audio, MMS, StyleTTS2, MAGNet, AudioGen, …

A fast inference library for running LLMs locally on modern consumer-class GPUs

Universal LLM Deployment Engine with ML Compilation

Faster Whisper transcription with CTranslate2

Whisper & Faster-Whisper standalone executables for those who don't want to bother with Python.