Skip to content

0.15.0 — faster fits: raced selection auditions

Choose a tag to compare

View all tags
@bbstats bbstats released this 16 Jul 21:01
v0.15.0
851ab7f

Highlights

  • selection_rounds (new, default 100): ~1.5x faster fits at the same accuracy. The internal selection fits (constant/linear leaf variants and the pre-cross-features base fit) now run as capped auditions judged on their best validation loss within a shared budget; only the winner continues to full early stopping. An audition that early-stops before the cap is reused as the finished model — that path is bit-identical to the previous behavior. selection_rounds=None restores the old run-everything-to-full-early-stopping selection.
  • Grinsztajn benchmark suite: fit time 351→235 s with accuracy columns flat; headline slowdown vs the fastest competitor improves 7.9x → 6.0x at unchanged blended strength (see images/pareto.png).
  • TabArena-Lite (report-only holdout): Elo 1256 (+54/−57), statistically unchanged, on a fresh 51-task run.
  • Measured trade-off, documented in the CHANGELOG: on a minority of regression datasets the 100-round audition can pick the leaf variant a full run would have rejected (typically 0.5–1.5% there).

Full details in CHANGELOG.md.

Assets 2
Loading