Repository navigation
v1.1.0
🏠 HomeBred-LLM — Local Model Files Support
This release adds the ability to load and run local model files directly from disk, with no downloads or external services required. Pick a .gguf file or an ONNX export from your own machine, point HomeBred-LLM at it, and start chatting immediately.
✨ New Features
🧠 GGUF Local Model Support
- New
GgufReader/GgufMetadataReaderservices parse GGUF v2/v3 files in-place to extract metadata (name, architecture, quantization, parameter count). - llama.cpp inference engine (
LlamaCppInferenceService) with native log capture viaNativeLogBuffer— replaces the older LLamaSharp service and runs entirely in-process. - New
GgufVerificationTestsconsole project that validates GGUF reading against real files.
🟦 ONNX Local Model Support
OnnxRuntimeServiceandOnnxModelMetadataReaderload and run local ONNX model exports.- Metadata extraction for architecture, parameter count, and quantization from ONNX files.
📂 Local Model Import
- New
LocalModelImportServiceregisters a local GGUF or ONNX model in the Model Library — the file is used in-place (no copying, since model files are often many gigabytes). - Import-time diagnostics surface warnings (e.g., HuggingFace-style tensor names, vocab size mismatch) as non-blocking badges in the UI.
InferenceServiceRouterautomatically picks the correct runtime based on file type: GGUF → llama.cpp, ONNX → ONNX Runtime.
🔧 LoRA & UI Improvements
- Reworked
LoraImportServicefor the new local-model workflow. - Model Library and Config views updated with a "Add Local Model" flow; app data layer (EF Core
AppDbContext,LocalModel) extended to persist local models across sessions.
🛠 What Changed
- 26 files changed, +2,594 / −431 lines
- New inference router, GGUF reader, ONNX reader, llama.cpp service, local model import, and verification tests
- UI/ViewModel updates for local model browsing and import