Skip to content

Detector submission update#131

Open
kprofundis wants to merge 2 commits intoliamdugan:mainfrom
kprofundis:odean-v17z-plus-soul-2026-05-04
Open

Detector submission update#131
kprofundis wants to merge 2 commits intoliamdugan:mainfrom
kprofundis:odean-v17z-plus-soul-2026-05-04

Conversation

@kprofundis
Copy link
Copy Markdown

@kprofundis kprofundis commented May 4, 2026

Independent research detector. Display name set via metadata.json. GitHub: https://github.com/KProfundis

@kprofundis kprofundis changed the title Add ODean v17z+soul submission Introducing Odean May 4, 2026
@kprofundis kprofundis changed the title Introducing Odean Add ODean v17z+soul submission May 4, 2026
@kprofundis kprofundis changed the title Add ODean v17z+soul submission Introducing Odean May 4, 2026
@kprofundis kprofundis marked this pull request as ready for review May 4, 2026 06:31
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 4, 2026

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

ODean v17z+soul

Release date: 2026-05-04

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 89.97 and a TPR of 57.91% at FPR=5% and 39.89% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 93.02 and a TPR of 67.97% at FPR=5% and 48.60% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

github-actions Bot pushed a commit to kprofundis/raid that referenced this pull request May 4, 2026
@liamdugan
Copy link
Copy Markdown
Owner

@kprofundis thanks for the submission and the kind message! Let me know if you'd like this to be merged.

@kprofundis
Copy link
Copy Markdown
Author

hey Liam! thank you for testing. could you merge my last results, that was aur 93? the V14 model? i‘m going to be fixing the bug in this recent submission but would love to see my previous score on the leadership board!

@liamdugan
Copy link
Copy Markdown
Owner

Sure thing @kprofundis , I reopened your previous PR #124 and kicked off eval. Once that's done I'll ask for a final approval from you on that thread.

@kprofundis
Copy link
Copy Markdown
Author

Thank you! I’ll keep an eye out for that message

@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 4, 2026

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

ODean v17z+soul × v14 routed-merge v2

Release date: 2026-05-04

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 94.30 and a TPR of 82.76% at FPR=5% and 69.20% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 96.92 and a TPR of 90.66% at FPR=5% and 80.90% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@kprofundis kprofundis force-pushed the odean-v17z-plus-soul-2026-05-04 branch from af89d34 to c777994 Compare May 4, 2026 16:54
@kprofundis kprofundis force-pushed the odean-v17z-plus-soul-2026-05-04 branch from c777994 to b965649 Compare May 4, 2026 16:55
@kprofundis kprofundis deployed to raid-main May 4, 2026 16:55 — with GitHub Actions Active
@kprofundis kprofundis changed the title Introducing Odean Detector submission update May 4, 2026
@github-actions
Copy link
Copy Markdown

github-actions Bot commented May 4, 2026

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Kareem Elsamadicy (Independent Researcher)

Release date: 2026-05-04

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 92.93 and a TPR of 82.42% at FPR=5% and 71.89% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 96.63 and a TPR of 90.10% at FPR=5% and 81.74% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants