ggerganov
Follow
Lists (6)
Stars
Run Orpheus 3B Locally With LM Studio
Voice-to-text app for macOS to transcribe what you say to text almost instantly
A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.…
transparent proxy server on demand model swapping for llama.cpp (or any local OpenAPI compatible server)
Two conversational AI agents switching from English to sound-level protocol after confirming they are both AI agents
VS Code extension for LLM-assisted code/text completion
A C++ header-only HTTP/HTTPS server and client library
A tiny Neovim plugin that adds subtle animations to various operations.
A minimalistic C++ Jinja templating engine for LLM chat templates
[ICLR 2025] SOTA discrete acoustic codec models with 40/75 tokens per second for audio language modeling
A blender addon for generating meshes with AI
ShellSage saves sysadmins’ sanity by solving shell script snafus super swiftly
Go library for embedded vector search and semantic embeddings using llama.cpp
Vim plugin for LLM-assisted code/text completion
An app that brings language models directly to your phone.
AI-powered assistant to help you with your daily tasks, powered by Llama 3, DeepSeek R1, and many more models on HuggingFace.
A Kotlin Multiplatform Project utilizing ggwave, a data-over-sound library.
Helping groups securely exchange contact information.
A live multiplayer trivia game where users can bid for the subject of the next question
Testing LLM reasoning abilities with family relationship quizzes.
An application for running LLMs locally on your device, with your documents, facilitating detailed citations in generated responses.
Stateful load balancer custom-tailored for llama.cpp 🏓🦙
asynchronous/distributed speculative evaluation for llama3