Skip to content

v0.8.0 — Recall quality improvements

Choose a tag to compare

@pbmagnet4 pbmagnet4 released this 10 Jun 03:18
· 51 commits to main since this release
4965082

What's new in 0.8.0

Smarter recall — no more noise on short prompts

Short/conversational messages ("yes please", "ok", "proceed") no longer fire FTS5 recall. A content-word extractor strips stopwords and returns empty recall when fewer than 2 content words remain, eliminating the garbage-session problem identified in query_log.jsonl.

Real-world precision measurement

New nlm precision CLI command joins query_log.jsonl × citation_log.jsonl to compute precision@k — the fraction of surfaced sessions that were actually cited. Run nlm precision --days 30 --verbose to see your recall quality.

Citation-frequency reranker

Sessions that have been explicitly cited in past conversations now receive a log-scaled score boost (ALPHA=0.15 × log(1 + count)) on top of FTS5 ranking. Zero-score results are never promoted above non-zero FTS5 hits. The reranker compounds over time as the citation log grows.

Upgrade

npm install -g nlm-memory@0.8.0

Requires Node >=22.