Skip to content

hubEvals 0.3.1

Choose a tag to compare

@annakrystalli annakrystalli released this 17 Jul 14:02
· 0 commits to 6e86151867eb36eabc9834348284f2e1993deda8 since this release
v0.3.1
dc1eda6
  • score_model_out() now handles disaggregated relative-skill scoring where some comparison groups (the by columns other than model_id) cannot be compared, instead of aborting the whole call with a cryptic scoringutils error ("Baseline comparator ... missing"). A group containing only one model is treated like the global single-model case, with relative skill filled as 1 (a model has skill 1 relative to itself). A group from which a requested baseline is absent has its relative and scaled relative skill reported as NA, with a warning naming the affected groups; the absolute scores for those groups are still returned unchanged. A baseline that is absent from the data entirely remains an error (#135).