Skip to content

v1.12.0: improve recall reply

Latest

Choose a tag to compare

@github-actions github-actions released this 10 Nov 11:06
· 31 commits to main since this release

What's Changed

This modifies the way recall returns its hits: instead of snippets of the surrounding chunks, it now returns the user and assistant prose starting and ending the exchange.

On the funes-memory question set in funes-recall-benchmark this puts the answer in the reply for 185 of 242 questions vs. 145 for the passages alone.

Cost: ~6.5k characters (~1.5k tokens) and ~0.25s added median latency per reply.

In addition, funes recall --neighbors is dropped, and funes recall --oneline is added.

Full Changelog: v1.11.0...v1.12.0