Skip to content

datalets v0.8.0 — know before, not during

Choose a tag to compare

@nashit8421 nashit8421 released this 29 Jul 10:17

Trust and pre-flight tooling from production field feedback:

  • estimate_cost(X, y) — the pre-flight plan: candidates and partition configs timed on a small subsample, extrapolated by complexity, printed before anything expensive runs. The 30-hour configuration is visible up front.
  • search_sample=50_000 — the auto partition search ranks configs on a stratified subsample above 50k rows and refits only the winner on full data (~10× cheaper at 500k).
  • cv_score_se in report() — fold-level uncertainty next to every specialist score: lift under ~2× the SE is noise, not signal.
  • segment_stability(X_new) — per-cluster share drift + PSI on new data: the trust check for temporal splits where partitions latch onto time-varying structure.
  • env_ — library-version fingerprint on every fitted object, shown in tree(). Models that carry their own provenance.
  • Docs: the large-data playbook — what to do before pressing go at 100k+ rows or 100+ features.

522 tests. CHANGELOG.md