Repository navigation
π LocalAI Advisor v2.0.0 β Major Architecture Overhaul
Welcome to the v2.0.0 release of LocalAI Advisor! This major update transitions the recommendation and performance models from static heuristic tables into a physics-grounded inference speed estimator (inspired by llmfit), while adding live Hugging Face intelligence, multi-GPU support, and advanced catalog filtering.
β¨ What's New in v2.0.0
-
π― Physics-Grounded Inference Speed Estimator (
llmfitapproach):- Decode throughput is now calculated directly from memory bandwidth:
tok/s = (Bandwidth Γ Efficiency) / (Model Size + KV Cache). - Built-in memory bandwidth database for ~40 modern GPU models (RTX 50/40/30/20 series, AMD RX 7000/6000, Intel Arc).
- Amdahl's Law layer offload latency modeling with PCIe transfer overhead for hybrid GPU+RAM execution.
- Mixture of Experts (MoE) support: memory footprint based on total parameters, token rate based on active routing experts.
- Decode throughput is now calculated directly from memory bandwidth:
-
ποΈ Multi-GPU & RAM Bandwidth Detection:
- Automatically aggregates VRAM across all dedicated GPUs in your system (
total_dedicated_vram_gb). - WMI physical memory inspection detects RAM clock speed (MHz), memory type (DDR4/DDR5), and memory channels to compute exact system RAM throughput for CPU modes.
- Automatically aggregates VRAM across all dedicated GPUs in your system (
-
π Live Hugging Face Auto-Sync & Enrichment:
- Automatic background sync upon launch if cache is older than 30 minutes.
- Real-time compatibility verification against your system's hardware limits.
- Model release year extraction displayed on model cards (e.g.
DeepSeek R1 Distill Qwen 14B (2025)). - Live "Last synced from Hugging Face: X min ago" status indicator in the status bar.
-
π Advanced Catalog Filtering:
- Toggle switch to filter / show uncensored and abliterated models.
- Date range filter dropdown (All Time, Last 1 Month, Last 6 Months, Last 1 Year).
-
π Responsive Desktop Interface:
- Disk cards and featured model cards dynamically adapt between 2, 3, and 4 columns based on window width.
- In-app automatic update notification when a new GitHub release is published.
π¦ Standalone Executable Download
| Asset | Size | Platform |
|---|---|---|
LocalAI-Advisor.exe |
~19.44 MB | Windows 10 / 11 (64-bit) |
π SHA256 Integrity Verification
Verify your download using PowerShell:
Get-FileHash .\LocalAI-Advisor.exe -Algorithm SHA256Expected SHA256:
A1FC334F7EDD96D729BDF78417F623562484D196A36E4CC525F17FCA00106D29