Repository navigation
v0.11.0
·
44 commits
to main
since this release
✨ Added
AsymptoticMultiPPRM: a new anytime-valid drift monitor that combines human labels with multiple proxy predictors (plus a matching synthetic dataset generator,generate_stratified_multi_binary_dataset, for testing it).- Interactive prediction-powered inference (PPI) simulator on the landing page, letting visitors explore the method interactively.
- New user guide sections covering the classical baseline estimators.
- New RAG answer faithfulness (MEMERAG) case study in the documentation.
🔄 Changed
- Renamed
AsymptoticClassicalMeanMonitortoAsymptoticClassicalRM, and removed the olderEmpiricalPPRMandEmpiricalClassicalMeanMonitormonitors along with their underlying confidence sequence, in favor of the newer asymptotic monitors. - Simplified the drift monitors'
detectmethods by removing themetric_lower_boundandmetric_upper_boundparameters. - Renamed the
n_totalparameter ton_samplesacross dataset generators for consistency. - Reorganized the tutorials: split into
estimators/andmonitors/subfolders, and added a monitoring section to the tutorials overview.
🐛 Fixed
- Fixed a color inconsistency in the landing page PPI simulator sliders.
💛 Contributors
Thank you to everyone who contributed to this release: @gmartinon-ed, @imerad, @pravallikamavilla