Skip to content

docs: G2b verdict — 4.8231; register-add neutralized the epoch gain - #176

Merged
ronaldtse merged 4 commits into
mainfrom
docs/g2b-verdict
Sep 4, 2026
Merged

docs: G2b verdict — 4.8231; register-add neutralized the epoch gain#176
ronaldtse merged 4 commits into
mainfrom
docs/g2b-verdict

Conversation

@ronaldtse

Copy link
Copy Markdown
Contributor

G2b verdict recorded from the volume's final_eval.json (the run's owners completed and evaluated it; EXPERIMENTS.md had only the old direction note):

  • 4.8231 full-set windowed DER (n=1200), teacher 2.289, paired bootstrap +2.3717 CI [2.194, 2.554]
  • Read: at 6 epochs, +18k classical units is flat vs the 3ep 30k control and 0.25pp worse than news-only G2a — the add neutralized the epoch gain
  • The domain-coverage attribution is now negative in BOTH directions (E6 swap 5.8057; G2b add 4.8231); post-E3 movers remain optimizer / fresher labels / epochs
  • Paper-B lever table extended (E5/E6/G2b rows) and the framing corrected; GKD (run-012, step ~4.3k/11k) is the last rung

Ronald Tse added 3 commits September 4, 2026 16:44
48k total with +18k classical Tashkeela at 6 epochs: flat vs the 3ep
4.8218 control, 0.25pp worse than news-only G2a 4.5701. Paired
bootstrap +2.3717 CI 2.194-2.554; teacher reproduces 2.289. With E6
swap 5.8057 the domain-coverage attribution is negative in BOTH
directions; Paper-B lever table gains E5/E6/G2b rows and the framing
line is corrected. Verdict read from final_eval.json on the volume;
recorded per TODO.substantiate item 04.
@ronaldtse
ronaldtse merged commit b92273b into main Sep 4, 2026
11 checks passed
@ronaldtse
ronaldtse deleted the docs/g2b-verdict branch September 4, 2026 14:48
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant