Skip to content

v0.2.6 -- Consistency Tests, P-values

Compare
Choose a tag to compare
@cnellington cnellington released this 13 May 22:39
· 114 commits to main since this release
40fe501

Contextualization adds new flexibility to model inference. In this update, we add tests to assess when contextualization captures meaningful heterogeneous effects, and determine when these effects should be ignored.

Use analysis.pvals to estimate the significance of effects captured by contextualized modeling

  • calc_homogeneous_context_effects_pvals tests if the direct effect of context on outcomes is significant
  • calc_homogeneous_predictor_effects_pvals tests if the effect of context-invariant models on outcomes is significant
  • calc_heterogeneous_predictor_effects_pvals tests it the effect of context-dependent models on outcomes is significant

Use analysis.bootstraps with select_good_bootstraps to select only training runs which converge for follow-up analysis.