Repository navigation
v1.10.0: GTE reranker and memory languages
This release mainly includes the replacement of the legacy BGE reranker by GTE modernbert.
The new reranker improves recall as soon as k > candidates, which becomes the new trigger. With the default k=8, candidates=30 values, the reranker is therefore always active.
In addition, the prompt language is detected at indexing time and stored in the memory. It is then used as a hint for the caller to improve recall by selecting the correct query language.
Upgrading from 1.9.x
No reindex. The first funes recall downloads the new reranker from the Hub (about 600 MB). The BAAI/bge-reranker-base weights are no longer used and can be deleted from ~/.cache/huggingface/hub.
A local memory gets its language counts on the next funes index. A remote memory pushed before 1.10.0 lists no languages, but everything works as before.
Bug Fixes:
- Evaluate unindexed count from manifest by @dacorvo in #268
- fix(bind): skip the first push to a memory this host published to before by @dacorvo in #269
- fix(status): read a memory at a path as it stands, not as the host's index by @dacorvo in #272
- fix(hub): find the token by hf-hub's rules by @dacorvo in #273
Full Changelog: v1.9.1...v1.10.0