Skip to content

v0.5.24 — CPU/GPU split model menus, phi4:3.8b as CPU default

Choose a tag to compare

@zettabrain zettabrain released this 19 May 19:21

What's changed

Improved model selection

The setup wizard now shows separate menus for CPU-only and GPU machines, with models chosen appropriately for each context.

CPU-only menu (no GPU detected):

  • phi4:3.8b is the new default — significantly better reasoning than llama3.2:3b at similar RAM usage
  • qwen3:0.6b, gemma3:1b, tinyllama:1.1b added as ultra-light options for very constrained hardware
  • llama3.2:3b kept as option 5

GPU menu (NVIDIA / AMD / Apple Silicon):

  • phi4:3.8b added as option 1 — useful for lower VRAM GPUs (< 5 GB)
  • openhermes:7b added as option 2 — sharp instruction-following at 4 GB VRAM
  • Updated recommendation thresholds: ≥ 8 GB → llama3.1:8b, ≥ 5 GB → mistral:7b, < 5 GB → phi4:3.8b

Also updated

  • server.py GPU recommendation logic updated to match the new thresholds
  • README model menus and performance reference table updated to reflect v0.5.24 changes

Upgrade

# Linux / macOS
sudo pipx upgrade zettabrain-rag

# Windows
pipx upgrade zettabrain-rag