Skip to content

Quirón 1.3.0

Choose a tag to compare

@github-actions github-actions released this 05 Nov 00:38
· 53 commits to main since this release
e40f608

This was the first read of all eight reference repos, so I went through each whole tree. Three small detection changes shipped, plus a change to evaluate.py so their gains show up in the repo's own output. I measured 27 candidates and 4 evaluation methods. Most were rejected, and two that passed the cheap screen made rewrites worse in the end-to-end runs.

The human corpora were rebuilt for this run (160 dev.to posts with 40 held out, 157 stories, 245 Spanish posts). dev.to no longer returns 7 of the posts behind the shipped bands, so the absolute figures differ a little from numbers.md. Every before/after pair below was measured on the same corpus, chosen on the training split and judged on the held-out one.

Shipped

Curly apostrophes count as straight ones in audit.py. The checklist patterns use ', and GPT writes it’s and let’s, so those posts slipped past A1, A4, A32, B3 and the rest. Source: theclaymethod/unslop@17ed39c, scripts/banned_phrase_scan.py.

checklist AUC, held-out before after
blog, GPT 0.830 0.854
blog, Opus 0.753 0.746
blog, Sonnet 0.997 0.996
fiction, GPT 0.911 0.922

No held-out human text fails anything new in any register. One blog post by a person now trips A4 (0% to 2.5%), and that one post is the whole of the Opus drop.

surprisingly joins the blog lexicon. The word lists from slop-score, Antislop and avoid-ai-writing@ccc8fc4 were scored one entry at a time against the rule every ai-lean.txt entry passed: no more than 4% of human posts and at least 10% of assistant posts, on the training split. Of 2,779 entries the lexicons did not already hold, one survived.

blog, held-out before after
B1 FAIL, GPT posts 43% 50%
AI-lexicon AUC, Sonnet 0.857 0.861
B1 FAIL, human posts 0% 0%

A3 now catches "the real X is" with any noun, not only "the real question is". Source: unslop@17ed39c, taboo-phrases.md.

blog, held-out before after
A3 on Sonnet posts 0% 14%
T1 FAIL, Sonnet 93% 100%
A3 on human posts 5% 5%

evaluate.py reports how often each check fires and the checklist AUC. Before this, a TELL check never showed up in its output, so none of the three changes above could be measured with the repo's own scripts.

Measured and not shipped

All of these are also in references/numbers.md, so they won't come up again without new evidence.

candidate source result
"X wasn't Y. It was Z." with any subject slop-score@289264a Checklist AUC went from 0.860 to 0.873. End to end, rewrites got worse on dev (Opus 32.0 to 34.0, p = 0.28) and held-out stayed flat (26.7 to 26.1)
Paragraphs that open on a word from the intro, as a meter feature unslop AI-side AUC rose from 0.879 to 0.881 (blog) and 0.829 to 0.849 (Spanish). Rewrites got worse: Opus +1.8 on dev, +2.4 on held-out
Seven fiction words (crouched, hollow, trembling…) Antislop Checked on 117 new stories and 30 new AI stories: one more human story fails (8.5% to 9.4%)
Fiction word list under the usual rule Antislop, slop-score B1 FAIL on held-out human stories went from 0% to 3%
2,529 fiction phrases Antislop None passed
Plain "not X, but Y" slop-score, Antislop A1b on held-out human posts rose from 12.5% to 27.5%
"No X, no Y, no Z" chains avoid-ai-writing One AI post caught in blog; one more held-out human story trips A1 in fiction
Phrase additions to A5, A9, A12, A16, A17, A21, A22, A24, A26 and B3 humanize, humanizer, no-ai-slop, avoid-ai-writing No hits on test, or more human hits. "Do you want me to" fails human dialogue in fiction
Title Case filter, proximity gate on A1 avoid-ai-writing Lower AUC; A19 stopped catching AI posts
Self-answered short questions, fillers, bare-noun bullet lists, hedge parentheses blader, avoid-ai-writing Fire more on human posts, or lower AUC
13 meter features (staccato runs, callbacks, n-gram repetition, specific anchors, bold, punctuation spread and others) slop-score, unslop, avoid-ai-writing Near chance, more overshoot in human texts, or a human flagged
"Lost" warnings in factdiff.py unslop, avoid-ai-writing Flagged 10 of 20 rewrites, nearly all list counters, ports and IDs
Copy gate against a voice sample unslop Fired on 7 of 19 rewrites. Every hit was the author's own sign-off, which the notes also had

Two findings from the end-to-end runs

Both are now in references/numbers.md.

  • The skill against one sentence of instruction. I gave the same rewriter the same notes and told it to make the text read naturally and add no facts. The skill came out well ahead: Opus 32.0 against 44.0 on dev (p = 0.001) and 26.7 against 32.1 on held-out (p = 0.011). The GPT judges point the same way. The notes don't account for the result on their own.
  • A human post given as the draft came back reading a little more AI than the original: Opus 6.0 to 7.5 (p = 0.056), GPT 6.4 to 7.9 (p = 0.09). On a text a person wrote, the loop costs a little.

Deferred

Nothing.

Notes

On Windows, build-corpus*.sh crashes on emoji unless you set PYTHONUTF8=1, because the console encoding is cp1252. This PR doesn't fix that.

The rewrites cost 144.5 USD, not counting the judges.

Version 1.3.0. All eight repos are marked as reviewed on 2026-11-04.