hubEvals 0.3.1
·
0 commits
to 6e86151867eb36eabc9834348284f2e1993deda8
since this release
score_model_out()now handles disaggregated relative-skill scoring where some comparison groups (thebycolumns other thanmodel_id) cannot be compared, instead of aborting the whole call with a crypticscoringutilserror ("Baseline comparator ... missing"). A group containing only one model is treated like the global single-model case, with relative skill filled as1(a model has skill1relative to itself). A group from which a requestedbaselineis absent has its relative and scaled relative skill reported asNA, with a warning naming the affected groups; the absolute scores for those groups are still returned unchanged. Abaselinethat is absent from the data entirely remains an error (#135).