v0.2.6 -- Consistency Tests, P-values
Contextualization adds new flexibility to model inference. In this update, we add tests to assess when contextualization captures meaningful heterogeneous effects, and determine when these effects should be ignored.
Use analysis.pvals
to estimate the significance of effects captured by contextualized modeling
calc_homogeneous_context_effects_pvals
tests if the direct effect of context on outcomes is significantcalc_homogeneous_predictor_effects_pvals
tests if the effect of context-invariant models on outcomes is significantcalc_heterogeneous_predictor_effects_pvals
tests it the effect of context-dependent models on outcomes is significant
Use analysis.bootstraps
with select_good_bootstraps
to select only training runs which converge for follow-up analysis.