Skip to content

Add Slop Or Not text detector submission#173

Closed
jeethu wants to merge 1 commit into
liamdugan:mainfrom
numen-tech:slop-or-not
Closed

Add Slop Or Not text detector submission#173
jeethu wants to merge 1 commit into
liamdugan:mainfrom
numen-tech:slop-or-not

Conversation

@jeethu

@jeethu jeethu commented Jul 1, 2026

Copy link
Copy Markdown

No description provided.

@github-actions

github-actions Bot commented Jul 6, 2026

Copy link
Copy Markdown

Eval run succeeded! Link to run: link

Here are the results of the submission(s):

Slop Or Not

Release date: 2026-07-01

I've committed detailed results of this detector's performance on the test set to this PR.

On the RAID dataset as a whole (aggregated across all generation models, domains, decoding strategies, repetition penalties, and adversarial attacks), it achieved an AUROC of 99.81 and a TPR of 99.52% at FPR=5% and 97.79% at FPR=1%.
Without adversarial attacks, it achieved AUROC of 99.88 and a TPR of 99.64% at FPR=5% and 99.09% at FPR=1%.

If all looks well, a maintainer will come by soon to merge this PR and your entry/entries will appear on the leaderboard. If you need to make any changes, feel free to push new commits to this PR. Thanks for submitting to RAID!

@jeethu

jeethu commented Jul 6, 2026

Copy link
Copy Markdown
Author

Hi @liamdugan, the eval results LGTM. Please feel free to merge this PR at your convenience. Thanks!

@liamdugan

Copy link
Copy Markdown
Owner

Hey @jeethu it looks like the bot encountered a problem

[slop-or-not b927464] leaderboard: add eval results (#173)
 1 file changed, 217721 insertions(+)
 create mode 100644 leaderboard/submissions/Slop-Or-Not/results.json
remote: Permission to numen-tech/raid.git denied to github-actions[bot].
fatal: unable to access 'https://github.com/numen-tech/raid/': The requested URL returned error: 403

Seems like your branch doesn't have edit permissions. Can you set your branch to be editable by maintainer? Then the bot will be able to push the eval results to the branch. Thanks

@jeethu

jeethu commented Jul 7, 2026

Copy link
Copy Markdown
Author

@liamdugan It looks like Github does not allow maintainer edit permissions for pull requests from forks hosted on organization accounts. I've recreated it from my personal account in #176.

@jeethu jeethu closed this Jul 7, 2026
@jeethu jeethu deleted the slop-or-not branch July 8, 2026 09:09
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants