SLM RAG Assistant — v1.1.0
A privacy-first document assistant that runs entirely on your machine. Upload PDF files and ask questions about their contents: the model answers using only what is actually in your documents, with source citations.
What's Changed
- Improved main interface by reducing clutter and moving certain elements to separate modules;
- Created a sliding side panel with additional model settings, such as temperature and chunk size during PDF ingestion;
- Created logging functionality that displays different types of logs in a dedicated logs panel. Also saves to a text file, inside a
logs/folder in the running directory; - Improved generation script by adding additional query and response quality checks;
- Improved generation instructions for both portuguese and english.
Full Changelog: v1.0.0...v1.1.0
Requirements: Python 3.12+ and a .gguf model file. See the README for setup instructions.