Skip to content

v0.3.9 - Fix RAG Chat Crash

Choose a tag to compare

@reallygood83 reallygood83 released this 07 Feb 06:22
· 2 commits to main since this release

Bug Fixes

RAG Chat Metal GPU Crash Fixed

  • Changed RAG Chat search from query (Hybrid) to vsearch (Semantic)
  • Fixes fatal error in ggml-metal-context.m:235 during query expansion
  • Significantly faster response time

Root Cause

The query command uses 3 AI models (embedding + generation + reranking) which caused Metal GPU crashes on some Macs. The vsearch command only uses embeddings, avoiding the crash.

Performance Note

  • Keyword search: Instant (no AI)
  • Semantic search: Fast (embeddings only)
  • Hybrid search: Slow (may crash on some systems)

If you still experience crashes, try using Keyword or Semantic mode instead of Hybrid.