Skip to content

v0.3.2 — benchmark + new rules

Choose a tag to compare

@yusasecurity yusasecurity released this 13 Nov 14:52
· 10 commits to main since this release

Benchmarked on deepset/prompt-injections (Apache-2.0, EN + DE). Rules tuned on the train split only; test split is a holdout.

split detection false positives precision
train (tuned on) 49.3% (100/203) 0/343 100%
test (holdout) 33.3% (20/60) 0/56 100%

Before this release the holdout detection was 3.3%.

New rules: blanket resets (forget/ignore everything, preceding orders), praise-then-new-task pivots, "that is done. now…", "now you are X", act-as personas, full-prompt leak requests, German variants.

Reproduce: npm run bench

Scanner, MCP server (yusa.mcpb), and GitHub Action (yusasecurity/yusa@v0.3.2) all updated. No false-positive regressions: 25/25 tests, 140 Aeon skills, 0 block.