Skip to content

v1.1.0 — numeric/unit floor + optional orthogonal NLI floor

Choose a tag to compare

@mcp-tool-shop mcp-tool-shop released this 03 Jun 21:43

Two more deterministic/orthogonal layers for the citation path, both precision-biased (neither can introduce a false-confirm), measured on a 56-case labeled set.

Added

  • Generalized numeric/unit floor — the deterministic numeric guard now catches unit-scale mismatches (a claim's "42 milliarcseconds" where the source says "42 micro-arcseconds") and comparison-direction falsehoods ("observed 5.0σ exceeded expected 5.8σ" when 5.0 < 5.8), beyond the existing percentage check. Refute-or-abstain; runs before the groundedness lens. 0 false-refutes on the labeled set.
  • Optional orthogonal NLI floor (prism.lenses.nli, opt-in) — an encoder NLI cross-encoder (DeBERTa-v3 NLI) vetoes a supported the LLM gave but a mechanistically-different model does not corroborate. Opt-in via the new nli extra (pip install "prism-verify[nli]") + PRISM_NLI_FLOOR; abstains/no-ops when absent, so the default install stays lightweight and CI is unchanged.

Consumers that shell the prism CLI (e.g. role-os's verify-citations) gain the numeric/unit floor automatically on upgrade; the NLI floor is opt-in via PRISM_NLI_FLOOR.