feat(competition): challenger kit restoring the auto backend - #565
Conversation
round-1 ladder entry: the round-0 canary champion pins the substring scan; this kit restores backend auto (fts5 with rrf fusion when embeddings exist). measured locally with the gate's own scorer on the day's derived seeds, the restore clears the dethrone band by a wide margin. kit-only change, as the ladder requires.
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. 🗂️ Base branches to auto review (2)
Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Path: .coderabbit.yaml Review profile: CHILL Plan: Pro Plus Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
koth ladder - dethroned {
"date": "2026-07-27",
"base_sha": "881127250ba3a680615d99bf73ab4376acfdcb69",
"seeds": [
90813253984371,
164084902193554,
261359132532710,
255327968308077,
88737840794468,
76942358585422,
142842187877729,
97581596516071,
157100008129172,
46217966697507,
46815146570875,
10927681347214
],
"champion": {
"scores": [
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2,
0.2
],
"mean": 0.2
},
"challenger": {
"scores": [
0.5,
0.6,
0.5,
0.6,
0.5,
0.6,
0.5,
0.6,
0.5,
0.6,
0.6,
0.7
],
"mean": 0.5666666666666667
},
"mean_diff": 0.36666666666666664,
"se": 0.01880253582725887,
"band": 0.03685297022142739,
"dethroned": true
}auto-merge on dethrone (provisional ladder branch). seeds derive from base sha + utc date; rerun locally with |
round-1 ladder entry: restore
backend: autoover the round-0 canary champion (substring).local precheck with the gate's own scorer (
.github/scripts/koth_score.py) at base sha 7243bd5, utc 2026-07-27: champion mean 0.20, challenger mean 0.55, paired diff +0.35 against a band of max(0.007, 1.96 x SE) = 0.0295 — dethrones on all 12 derived seeds.reproduce:
kit-only change, as the ladder requires. expected gate behaviour: classify as ladder PR, validate against the allowlist, run paired scoring, post the scorecard comment, verdict dethroned, enable squash auto-merge (base is the KOTH_LADDER_BASE branch).