[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Multi-platform desktop app to download and run Large Language Models(LLM) locally in your computer.

An implementation of the diffusers api in Rust

Stable Diffusion XL ported to Rust's burn framework

Rust bindings to https://github.com/ggerganov/whisper.cpp

Bringing stable diffusion models to web browsers. Everything runs inside the browser with no server support.

Inference Llama 2 in one file of pure C

⚡️ Web Performance Research

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama. Any Vectorstore: …