Skip to content

Add mango RAID submission#127

Open
drfein wants to merge 2 commits intoliamdugan:mainfrom
drfein:mango
Open

Add mango RAID submission#127
drfein wants to merge 2 commits intoliamdugan:mainfrom
drfein:mango

Conversation

@drfein
Copy link
Copy Markdown

@drfein drfein commented Apr 30, 2026

Adds RAID test predictions for the mango detector.

@github-actions
Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

mango

Release date: 2026-04-30

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 95.31 and a TPR of 97.89% at FPR=5% and 89.72% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 96.20 and a TPR of 97.39% at FPR=5% and 91.58% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@liamdugan
Copy link
Copy Markdown
Owner

@drfein let me know if you'd like me to merge this submission!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants