Repository navigation
LocalRAG v0.10.0
LocalRAG 0.10.0 refreshes the local model stack while keeping the proven default configuration conservative.
Highlights
- Recommended Ollama models are grouped into practical hardware profiles:
qwen3.5:4b— lightqwen3.5:9b— balanced defaultgemma4:12b— qualitygranite4.2:8b— experimental RAG profileqwen3.6:27b— experimental workstation profile
- Recommended embedding models now include
Qwen/Qwen3-Embedding-0.6Band optionalgoogle/embeddinggemma-300m. - E5 uses the required
query:andpassage:retrieval prefixes. - Qwen3 Embedding uses its query instruction; EmbeddingGemma uses retrieval query/document prompts; GTE enables its required remote model code.
- All supported embedding profiles normalize vectors.
- FAISS persists the embedding model and adapter version and refuses incompatible legacy indexes, triggering a safe rebuild.
- The model manager shows download size, context window, hardware profile, stability status, and license caveats.
- The bundled Ollama image is updated to
0.33.3.
Compatibility Notes
- The default runtime remains
qwen3.5:9bwithintfloat/multilingual-e5-large. - The first start after upgrading rebuilds a legacy FAISS index because E5 now uses its correct asymmetric retrieval prefixes.
google/embeddinggemma-300mrequires accepting the Gemma license while signed in to Hugging Face.granite4.2:8bis marked experimental for Russian and Hebrew because they are not listed among its officially supported languages.- Older installed Ollama models remain selectable and participate in fallback resolution; they are only removed from the primary recommendation list.
Verification
- Python syntax and locale JSON validation
- Full
pytest -qsuite - Docker Compose configuration validation
- Release archive, checksum, and manifest generation
- GitLab exact-SHA CI gates and GitHub publication checks