Skip to content

v1.1.0

Latest

Choose a tag to compare

@RafaelB411 RafaelB411 released this 21 Mar 18:47
a98d168

SmolRag

Changelog

  • Disabled chat history to improve prefill time and prevent exceeding the max token limit;
  • Added support for the Granite 30M embedding model in the application.

Two apk files are provided: one using bge-small-en-v1.5 and the other using granite-30m-english as the embedding model.
The version with Granite demonstrated better performance.

We recommend using the LLM "Qwen2.5 1.5B Q8 Instructions".