Skip to content

v2.0.0 - Major Architecture Overhaul (Physics Engine & Live Sync)

Latest

Choose a tag to compare

@keplerTR keplerTR released this 01 Sep 20:44
· 4 commits to main since this release

πŸš€ LocalAI Advisor v2.0.0 β€” Major Architecture Overhaul

Welcome to the v2.0.0 release of LocalAI Advisor! This major update transitions the recommendation and performance models from static heuristic tables into a physics-grounded inference speed estimator (inspired by llmfit), while adding live Hugging Face intelligence, multi-GPU support, and advanced catalog filtering.


✨ What's New in v2.0.0

  • 🎯 Physics-Grounded Inference Speed Estimator (llmfit approach):

    • Decode throughput is now calculated directly from memory bandwidth: tok/s = (Bandwidth Γ— Efficiency) / (Model Size + KV Cache).
    • Built-in memory bandwidth database for ~40 modern GPU models (RTX 50/40/30/20 series, AMD RX 7000/6000, Intel Arc).
    • Amdahl's Law layer offload latency modeling with PCIe transfer overhead for hybrid GPU+RAM execution.
    • Mixture of Experts (MoE) support: memory footprint based on total parameters, token rate based on active routing experts.
  • πŸŽ›οΈ Multi-GPU & RAM Bandwidth Detection:

    • Automatically aggregates VRAM across all dedicated GPUs in your system (total_dedicated_vram_gb).
    • WMI physical memory inspection detects RAM clock speed (MHz), memory type (DDR4/DDR5), and memory channels to compute exact system RAM throughput for CPU modes.
  • 🌐 Live Hugging Face Auto-Sync & Enrichment:

    • Automatic background sync upon launch if cache is older than 30 minutes.
    • Real-time compatibility verification against your system's hardware limits.
    • Model release year extraction displayed on model cards (e.g. DeepSeek R1 Distill Qwen 14B (2025)).
    • Live "Last synced from Hugging Face: X min ago" status indicator in the status bar.
  • πŸ” Advanced Catalog Filtering:

    • Toggle switch to filter / show uncensored and abliterated models.
    • Date range filter dropdown (All Time, Last 1 Month, Last 6 Months, Last 1 Year).
  • πŸ“ Responsive Desktop Interface:

    • Disk cards and featured model cards dynamically adapt between 2, 3, and 4 columns based on window width.
    • In-app automatic update notification when a new GitHub release is published.

πŸ“¦ Standalone Executable Download

Asset Size Platform
LocalAI-Advisor.exe ~19.44 MB Windows 10 / 11 (64-bit)

πŸ”’ SHA256 Integrity Verification

Verify your download using PowerShell:

Get-FileHash .\LocalAI-Advisor.exe -Algorithm SHA256

Expected SHA256:

A1FC334F7EDD96D729BDF78417F623562484D196A36E4CC525F17FCA00106D29