Skip to content

Add Tabularis ModernBERT R1 detector #137

Open
unnir wants to merge 4 commits into
liamdugan:mainfrom
unnir:add-tabularis-modernbert-r1
Open

Add Tabularis ModernBERT R1 detector #137
unnir wants to merge 4 commits into
liamdugan:mainfrom
unnir:add-tabularis-modernbert-r1

Conversation

@unnir
Copy link
Copy Markdown

@unnir unnir commented May 10, 2026

testing new version*

@Onlyartist9
Copy link
Copy Markdown
Contributor

Hey @liamdugan. Any hints as to why this submission might be halted?
Thanks.

@github-actions
Copy link
Copy Markdown

ghost commented May 12, 2026

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Tabularis ModernBERT R1

Release date: 2026-05-10

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.04 and a TPR of 98.15% at FPR=5% and 93.06% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.45 and a TPR of 99.03% at FPR=5% and 97.05% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@unnir
Copy link
Copy Markdown
Author

unnir commented May 20, 2026

@liamdugan, could you please approve the review?

We significantly improve our model, looking forward to the results

@github-actions
Copy link
Copy Markdown

ghost commented May 20, 2026

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Tabularis ModernBERT R1.1 (NFKC)

Release date: 2026-05-20

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.55 and a TPR of 98.98% at FPR=5% and 95.92% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.60 and a TPR of 99.15% at FPR=5% and 97.20% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants