Repository navigation
SmolRag
Changelog
- Disabled chat history to improve prefill time and prevent exceeding the max token limit;
- Added support for the Granite 30M embedding model in the application.
Two apk files are provided: one using bge-small-en-v1.5 and the other using granite-30m-english as the embedding model.
The version with Granite demonstrated better performance.
We recommend using the LLM "Qwen2.5 1.5B Q8 Instructions".