Repository navigation
v0.3.9 - Fix RAG Chat Crash
Bug Fixes
RAG Chat Metal GPU Crash Fixed
- Changed RAG Chat search from
query(Hybrid) tovsearch(Semantic) - Fixes fatal error in ggml-metal-context.m:235 during query expansion
- Significantly faster response time
Root Cause
The query command uses 3 AI models (embedding + generation + reranking) which caused Metal GPU crashes on some Macs. The vsearch command only uses embeddings, avoiding the crash.
Performance Note
- Keyword search: Instant (no AI)
- Semantic search: Fast (embeddings only)
- Hybrid search: Slow (may crash on some systems)
If you still experience crashes, try using Keyword or Semantic mode instead of Hybrid.