Repository navigation
v1.0.0
Release Notes — HomeBred-LLM v1.0.0
First public release · 2026-07-01
Cross-platform, self-hosted LLM desktop app — download, configure, run, and chat with local models entirely on your own machine. No Ollama, no Docker, no Python, no cloud. Everything runs in-process on Windows, Linux, and macOS.
🎉 Highlights
HomeBred-LLM embeds llama.cpp in-process via LLamaSharp — the same engine that powers Ollama — with model management, GPU monitoring, chat, a local API, and LoRA adapters all inside one self-contained Avalonia desktop app.
✨ Features
📦 Model Library
Search HuggingFace directly from the app — no HF CLI or Python.
Browse a repo's GGUF files by quantization and size.
Download with a real-time progress bar (MB downloaded / total).
Automatic vision projector (mmproj) detection — multimodal models get their projector downloaded alongside the weights.
⚙️ Model Configuration
Per-model tuning of:
Temperature, Top-P, Top-K, repeat penalty
Context size, GPU layer count, CPU threads, batch size
Max output tokens and system prompt
Save / reset-to-defaults, persisted in the local database.
🧬 LoRA Adapters (specialize without retraining)
Attach one or more pre-trained GGUF LoRA adapters to any model.
Per-adapter blend scale and on/off toggle; stack multiple adapters.
Applied to both chat and the embeddings endpoint at load time.
Imported files are validated (GGUF check) and stored in a managed adapters/ folder.
Application only — training is done externally and converted to GGUF.
Start — load weights into GPU VRAM (or CPU).
Stop — unload without restarting the app.
Remove — delete the file and its database record.
💬 Streaming Chat
Token-by-token streaming output.
Multiple named chat sessions per model.
Image and text file attachments (drag-and-drop or picker); images route to vision-capable models.
Per-message stats: tokens/sec and latency.
📊 Live Analytics
Sampled every 5 seconds and charted:
GPU utilization %, VRAM used/total, GPU temperature (via NVML)
CPU utilization and RAM
Per-request tokens/sec, time-to-first-token, total inference time, and prompt/output token counts
Cleanup tool — delete metrics for any model over any date range without touching the model.
🔌 Local API Endpoint
Optional, opt-in per model.
OpenAI-compatible POST /v1/chat/completions (streaming supported) and POST /v1/embeddings.
Configurable port, bound to 127.0.0.1 only — no separate process.
🖥️ Platform & engine
.NET 10, cross-platform: Windows · Linux · macOS.
GPU: NVIDIA CUDA 12 with automatic CPU fallback — both backends bundled; CUDA selected automatically when drivers are present.
Inference: LLamaSharp 0.27 (P/Invoke bindings to llama.cpp), fully in-process.
UI: Avalonia 11.2 + CommunityToolkit.Mvvm; LiveCharts2 for analytics.
Storage: SQLite via EF Core — auto-created on first launch, schema self-upgrades in place.
📁 Data storage
All data lives in one folder per platform (%LOCALAPPDATA%\HomeBred-LLM\ on Windows, ~/.local/share/HomeBred-LLM/ on Linux, ~/Library/Application Support/HomeBred-LLM/ on macOS):
homebred.db # models, configs, analytics, chat history
models/ # downloaded GGUF weights
adapters/ # imported LoRA adapters
attachments/ # chat file attachments
Uninstall = delete the binary and this folder. No registry entries, no system-wide changes.
✅ Supported models
Any GGUF on HuggingFace, including LLaMA 3.x, Mistral / Mixtral, Qwen 2/2.5, Phi-3/Phi-4, Gemma 2/3, DeepSeek, and any other llama.cpp-supported architecture. Recommended quantizations: Q4_K_M, Q5_K_M, Q6_K.
📋 Requirements
.NET 10 runtime (or publish self-contained)
4 GB VRAM minimum for small models; 8–16 GB for 13B+ at full GPU offload
Disk: ~2 GB (Q4 7B) to ~40 GB (Q4 70B) per model
LoRA adapters apply at load time — Stop/Start a model to pick up changes.
Only GGUF-format adapters are supported (convert PEFT/.safetensors externally).
Apple Silicon / Metal and AMD ROCm backends are planned, not yet included.