Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs
-
Updated
Jul 2, 2025 - Rust
#
private-llm
Here are 7 public repositories matching this topic...
The Privacy Firewall for LLMs
privacy mcp claude anonymization pdf-processing pseudonymization pdf-redaction private-llm model-context-protocol mcp-server pdf-pseudonymization
-
Updated
Jun 23, 2025 - Python
Verify claims using AI agents that debate using scraped evidence and local language models.
python scraping beautifulsoup autonomous-agents local-inference qwen lm-studio langgraph private-llm agentic-ai claim-verification phi-4-mini evidence-based-ai
-
Updated
Jun 1, 2025 - Python
AskYourDocs is a private, open-source GenAI assistant that lets you chat with your internal documents (PDFs, DOCX) using powerful language models — deployable via HuggingFace Spaces with minimal setup.
natural-language-processing semantic-search rag huggingface document-ai streamlit-app knowledge-based-ai gen-ai open-source-ai private-llm
-
Updated
May 13, 2025
Bot for IRC and Discord with LocalLLM and LLM support
-
Updated
Jul 14, 2025 - Python
Create a Small LLM using EleutherAI/gpt-neo-2.7B - Fine Tune It for a Specalized Purpouse and Leverage as a Co-Pilot
-
Updated
May 23, 2024 - HTML
AI tool to help users research using local LLMs and automated web search.
python google gemma streamlit lm-studio langgraph private-llm tavily-api privacy-first-ai tavily-search next-gen-ai google-gemma-3-1b instruction-tuned-llm gguf-model-support
-
Updated
Jun 9, 2025 - Python
Improve this page
Add a description, image, and links to the private-llm topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the private-llm topic, visit your repo's landing page and select "manage topics."