Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
-
Updated
Jul 2, 2025 - Rust
Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
The Privacy Firewall for LLMs
Verify claims using AI agents that debate using scraped evidence and local language models.
Create a Small LLM using EleutherAI/gpt-neo-2.7B - Fine Tune It for a Specalized Purpouse and Leverage as a Co-Pilot
AskYourDocs is a private, open-source GenAI assistant that lets you chat with your internal documents (PDFs, DOCX) using powerful language models — deployable via HuggingFace Spaces with minimal setup.
Bot for IRC and Discord with LocalLLM and LLM support
AI tool to help users research using local LLMs and automated web search.
Add a description, image, and links to the private-llm topic page so that developers can more easily learn about it.
To associate your repository with the private-llm topic, visit your repo's landing page and select "manage topics."