Skip to content

v0.3.0

Latest

Choose a tag to compare

@github-actions github-actions released this 04 Oct 03:26

Changelog

  • c6002c1 Add toonx codec, held-out payload set and payload Q&A; amend pre-registration
  • baa808d Amendment 7 header link; toonx package doc for version 4
  • 6f91f8c Count a call as failed only if it never succeeded
  • 2a6d94c Give each model its own pool of in-flight calls
  • 8dc86c8 Keep reasoning text, finish reason and start time for every call
  • 4518eb5 One toonx: keep version 3, remove version switches
  • cec45b5 PILOT.md: correct pilot 3's question-kind count
  • f1276a7 Pre-register Amendment 6: split wide tables, cost-weighted pilot 3
  • a33ca23 Pre-register Amendment 8: the full run, and the promotion replay
  • 3996b05 Pre-register a free-form quality check with a blind judge
  • 7cdb604 Pre-register a ~100-call pilot; add -sample to the bench harness
  • a2a947c Pre-register the verification benchmark and extend the harness
  • 2823524 Publish the four-model write-up and update README and OVERHEAD
  • 568dc84 Publish the verification run: records, data points and VERIFY.md
  • 8ab0d52 Record free-form check: no-large-drop claim not supported
  • 5b104f5 Record outlier check on toonx 3 (7 calls)
  • 8f4c21b Record pilot 2 diagnostic: keep toonx 2, run at 16384 output tokens
  • 4e1faa3 Record pilot 2; pre-register a diagnostic of its nemotron failures
  • a02021f Record pilot 3: toonx-split qualifies under Amendment 6
  • 9dcf89c Record pilot 4: toonx 3 kept, toonx 4 not adopted
  • 86792a2 Record smoke checks and pilot results
  • e16ed1b Record the non-reasoning smoke check and full-run settings
  • 578e3e9 Replace the retired nemotron-3-super with nemotron-3-ultra (Amendment 9)
  • c7b08ed Switch a confidently worse route OFF even with a Tier 1 regression
  • eeee9e3 toonx 2: factor out constant fields and URL prefixes; pre-register pilot 2
  • 410e072 toonx 3: split tables wider than 8 columns
  • f823530 toonx 4 and Amendment 7: row key in split parts, marked prefixes