Skip to content

Release: v0.15.1

Choose a tag to compare

@shinpr shinpr released this 12 Jun 12:14
b1bbcfd

Added

  • Configurable embedding dtype via RAG_DTYPE. Choose the embedding quantization (fp32, fp16, q8, int8, …) with an opt-in environment variable. The default is fp32, so existing setups are unchanged. If the chosen model does not provide the requested dtype, the server fails with an error that lists the dtypes the model does provide. Changing RAG_DTYPE (or RAG_DEVICE) changes the embedding space, so re-ingest your documents after changing it.

Changed

  • Clearer error reporting. Errors now keep their real cause instead of being masked. For example, a dtype/model misconfiguration during PDF ingestion now reports the actual problem rather than a generic “Failed to parse PDF”. Full diagnostic detail (cause chain) is written to stderr logs; MCP clients receive a clean, controlled message.
  • A failed re-ingest whose rollback also fails now reports a distinct error stating that existing data may not have been restored.