Skip to content

v0.40.0

Choose a tag to compare

View all tags
@dunkleschitz dunkleschitz released this 10 Nov 00:50
· 16 commits to main since this release
v0.40.0
6b1854d

agentsec v0.40.0

Independent red-team detection benchmark.

  • Added benchmarks/redteam/ (~100 adversarial + benign look-alike samples across 10 tools) with SOURCES.md citing published research (Invariant Labs, Trail of Bits, CyberArk, Embrace The Red, Aim Security EchoLeak, PortSwigger, Pillar Security, Supabase MCP / General Analysis, Amazon Q wipe prompt, MINJA, Nx s1ngularity).
  • Samples written without reading detector source or rule files (READMEs only).
  • Pages section Independent red-team results: overall P=93.8% R=85.7% F1=89.6% (60/4/10/26) — below the author-written corpus.
  • Filed detection-gap issues #12–#16 for false negatives; did not retune tools against these fixtures.
  • Kit still 35 tools / 1675 tests.
Assets 2
Loading