Skip to content

v2.5.0 — verify-citations --local-panel

Choose a tag to compare

View all tags
@mcp-tool-shop mcp-tool-shop released this 03 Jun 14:03
· 57 commits to main since this release
v2.5.0
0cc87e2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

A second, family-different verifier seat for the citation gate.

roleos verify-citations --local-panel adds a local 3-seat entailment panel (Qwen3-4B + Qwen3-14B + Mistral-Nemo-12B) that re-checks each citation an external verifier marked supported, and escalates to human review on disagreement — it can only tighten the gate, never loosen it. Runs entirely on local models, zero cost.

Why it matters: the panel's measured property is zero false-confirms — it never stamps a false claim "supported." On a real 16-case arXiv citation set, one model false-confirmed a claim that inverted a paper's finding; the panel held it at insufficient.

Opt in with --local-panel (off by default; needs a local llama-swap + offload). +16 tests, 1196 total. See CHANGELOG.md for details.

Assets 2
Loading