Skip to content

v1.1.0

Choose a tag to compare

@Eisenmann Eisenmann released this 20 Sep 17:55
· 8 commits to main since this release
3955462

🏠 HomeBred-LLM — Local Model Files Support

This release adds the ability to load and run local model files directly from disk, with no downloads or external services required. Pick a .gguf file or an ONNX export from your own machine, point HomeBred-LLM at it, and start chatting immediately.

✨ New Features

🧠 GGUF Local Model Support

  • New GgufReader / GgufMetadataReader services parse GGUF v2/v3 files in-place to extract metadata (name, architecture, quantization, parameter count).
  • llama.cpp inference engine (LlamaCppInferenceService) with native log capture via NativeLogBuffer — replaces the older LLamaSharp service and runs entirely in-process.
  • New GgufVerificationTests console project that validates GGUF reading against real files.

🟦 ONNX Local Model Support

  • OnnxRuntimeService and OnnxModelMetadataReader load and run local ONNX model exports.
  • Metadata extraction for architecture, parameter count, and quantization from ONNX files.

📂 Local Model Import

  • New LocalModelImportService registers a local GGUF or ONNX model in the Model Library — the file is used in-place (no copying, since model files are often many gigabytes).
  • Import-time diagnostics surface warnings (e.g., HuggingFace-style tensor names, vocab size mismatch) as non-blocking badges in the UI.
  • InferenceServiceRouter automatically picks the correct runtime based on file type: GGUF → llama.cpp, ONNX → ONNX Runtime.

🔧 LoRA & UI Improvements

  • Reworked LoraImportService for the new local-model workflow.
  • Model Library and Config views updated with a "Add Local Model" flow; app data layer (EF Core AppDbContext, LocalModel) extended to persist local models across sessions.

🛠 What Changed

  • 26 files changed, +2,594 / −431 lines
  • New inference router, GGUF reader, ONNX reader, llama.cpp service, local model import, and verification tests
  • UI/ViewModel updates for local model browsing and import