Skip to content

umbra-eval v0.2.1 — README benchmark docs + umbra-core>=0.5.0

Choose a tag to compare

View all tags
@bkd-dotcom bkd-dotcom released this 30 Jul 21:47
· 22 commits to main since this release
v0.2.1
0573cea
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.
  • README now documents the detection head-to-head benchmark (52 cases / 7 languages; umbra-core 100% recall / 0 FP vs Claude Opus 4.8 90%) + the corpus/realrepo commands.
  • Fix: dependency floor raised to umbra-core>=0.5.0 so a fresh install always has the detection engine.
  • Honest note: any false positive comes from the optional Semgrep layer, not the deterministic engine (which is 0-FP on the corpus).
Assets 2
Loading