Repository navigation
What's Changed
This modifies the way recall returns its hits: instead of snippets of the surrounding chunks, it now returns the user and assistant prose starting and ending the exchange.
On the funes-memory question set in funes-recall-benchmark this puts the answer in the reply for 185 of 242 questions vs. 145 for the passages alone.
Cost: ~6.5k characters (~1.5k tokens) and ~0.25s added median latency per reply.
In addition, funes recall --neighbors is dropped, and funes recall --oneline is added.
Full Changelog: v1.11.0...v1.12.0