v0.5.24 — CPU/GPU split model menus, phi4:3.8b as CPU default
What's changed
Improved model selection
The setup wizard now shows separate menus for CPU-only and GPU machines, with models chosen appropriately for each context.
CPU-only menu (no GPU detected):
phi4:3.8bis the new default — significantly better reasoning thanllama3.2:3bat similar RAM usageqwen3:0.6b,gemma3:1b,tinyllama:1.1badded as ultra-light options for very constrained hardwarellama3.2:3bkept as option 5
GPU menu (NVIDIA / AMD / Apple Silicon):
phi4:3.8badded as option 1 — useful for lower VRAM GPUs (< 5 GB)openhermes:7badded as option 2 — sharp instruction-following at 4 GB VRAM- Updated recommendation thresholds: ≥ 8 GB →
llama3.1:8b, ≥ 5 GB →mistral:7b, < 5 GB →phi4:3.8b
Also updated
server.pyGPU recommendation logic updated to match the new thresholds- README model menus and performance reference table updated to reflect v0.5.24 changes
Upgrade
# Linux / macOS
sudo pipx upgrade zettabrain-rag
# Windows
pipx upgrade zettabrain-rag