Skip to content

RAGOps v2.7.0

Choose a tag to compare

@thangldw thangldw released this 20 Nov 01:12
· 7 commits to main since this release
471d26c

RAGOps v2.7.0

New

  • ragops counterfactual-selftest: check the counterfactual checks on your own scenario, with no system and no network. It builds an evidence-copying reference and an evidence-ignoring (or injection-obeying) system from your cases and reports, per perturbation, how often the reference is wrongly flagged, how often the failing system is caught, and whether enough cases apply (valid, weak, too_few_cases; exit 0, 2, 3). See counterfactual-test.md.
  • The Claude Code / Cowork plugin now lives in plugins/ragops/ (Markdown, JSON and icon only, as the plugin directory requires for unverified organizations) and calls the ragops CLI installed with pip install ragops. The skill documents the self-test.

Limits

The self-test uses two toy systems; VALID means the checks are usable on your data, not that they find your real system's failures. counterfactual itself has not been measured on a real RAG system.

Compatibility

No breaking changes. The plugin's manifest moved to plugins/ragops/.claude-plugin/plugin.json; install commands are unchanged.