Skip to content

v0.11.0

Choose a tag to compare

@pravallikamavilla pravallikamavilla released this 18 Sep 12:45
· 44 commits to main since this release
116baf1

✨ Added

  • AsymptoticMultiPPRM: a new anytime-valid drift monitor that combines human labels with multiple proxy predictors (plus a matching synthetic dataset generator, generate_stratified_multi_binary_dataset, for testing it).
  • Interactive prediction-powered inference (PPI) simulator on the landing page, letting visitors explore the method interactively.
  • New user guide sections covering the classical baseline estimators.
  • New RAG answer faithfulness (MEMERAG) case study in the documentation.

🔄 Changed

  • Renamed AsymptoticClassicalMeanMonitor to AsymptoticClassicalRM, and removed the older EmpiricalPPRM and EmpiricalClassicalMeanMonitor monitors along with their underlying confidence sequence, in favor of the newer asymptotic monitors.
  • Simplified the drift monitors' detect methods by removing the metric_lower_bound and metric_upper_bound parameters.
  • Renamed the n_total parameter to n_samples across dataset generators for consistency.
  • Reorganized the tutorials: split into estimators/ and monitors/ subfolders, and added a monitoring section to the tutorials overview.

🐛 Fixed

  • Fixed a color inconsistency in the landing page PPI simulator sliders.

💛 Contributors

Thank you to everyone who contributed to this release: @gmartinon-ed, @imerad, @pravallikamavilla