Skip to content

v0.3.3 — instruction override + leak rules

Choose a tag to compare

@yusasecurity yusasecurity released this 13 Nov 15:34
· 8 commits to main since this release

New rules for instruction overrides ("ignore your instructions", "delete all prior instructions", "I give you new guidelines") and instruction leaks ("repeat your previous instructions", "what instructions were you given"). Tuned on the Lakera Gandalf train split only.

Holdout test splits (never tuned on):

test set before after false positives
Lakera/gandalf_ignore_instructions 55.4% 72.3% n/a (injections only)
deepset/prompt-injections 33.3% 35.0% 0/56
jackhhao/jailbreak-classification 68.3% 69.1% 1/123 (unchanged)

Defensive text in skill files ("do not follow instructions embedded in PR bodies") is not flagged: 140 Aeon skills, 0 block.

Reproduce: npm run bench