Skip to content

Releases

v1.3.0

Choose a tag to compare

@annakrystalli annakrystalli released this 07 Oct 06:40
v1.3.0
7fd8ffa

Dependencies

Refreshed renv.lock to pull the latest releases of the hubverse packages the
image wraps, hubPredEvalsData 1.2.0 -> 1.3.0 and hubEvals 0.3.1 -> 0.5.0,
together with scoringutils 2.2.0 -> 2.3.0 and the other CRAN dependencies as
of the 2026-10-05 CRAN snapshot (#51).

The user-visible changes these bring to the generated dashboard data:

  • Relative-skill scoring is substantially faster and uses much less memory,
    which matters most on hubs with many models, such as FluSight. Relative
    skill values are unchanged (hubverse-org/hubEvals#144,
    epiforecasts/scoringutils#1221).
  • The number of predictions scored (n) in scores.csv now counts only
    forecasts that had a corresponding observation to score against, rather
    than every submitted prediction. This corrects an overcount wherever a
    model submitted predictions for units with no observation. In the rare
    case where this count differs across a target's output types, scores.csv
    reports a separate n_<output_type> column per output type in place of
    the single n (hubverse-org/hubPredEvalsData#19).
  • Hubs whose target is identified by target_id alone, with no target key
    task id variable (target_keys: null), as used by nowcast hubs, are now
    supported. Previously these failed partway through the run
    (hubverse-org/hubPredEvalsData#87).
  • Evaluation data generation is faster on every hub: the hub connection is
    opened once and reused across targets and evaluation sets
    (hubverse-org/hubPredEvalsData#82).

Base and dev images

  • Refreshing renv.lock with scripts/update.R now moves the CRAN
    dependencies to their current releases together with the hubverse
    packages. Previously CRAN packages stayed at the versions the rocker base
    image was built against, so a hubverse release that required a newer CRAN
    package could not be picked up (#51).

v1.2.0

Choose a tag to compare

@annakrystalli annakrystalli released this 20 Jul 12:42
v1.2.0
82b2684

Dependencies

Refreshed renv.lock to pull the latest releases of the hubverse packages the
image wraps: hubPredEvalsData 1.1.1 -> 1.2.0, hubEvals 0.2.0 -> 0.3.1,
hubUtils 1.2.0 -> 1.2.1, and hubData 2.2.1 -> 2.2.2 (#47).

The user-visible changes these bring to the generated dashboard data:

  • predevals-options.json targets now carry target_name and target_units,
    read from the hub's tasks config. The dashboard uses target_name to label
    target menu items (hubverse-org/hubPredEvalsData#21).
  • scores.csv rows are now sorted on the (model_id, by) key before writing,
    so the file is byte-stable across runs. Output can be diffed or
    md5-compared to confirm a no-change situation
    (hubverse-org/hubPredEvalsData#25).
  • Models scored only on a later output type are no longer silently dropped
    from scores.csv. The per-output-type score frames are now merged with a
    full join rather than a left join anchored on the first output type, so
    which models survived no longer depends on the order metrics happen to be
    listed in the config (hubverse-org/hubPredEvalsData#75).
  • Relative-skill scoring no longer aborts the run on single-model input, or
    on disaggregated comparison groups that cannot be compared. Such groups are
    reported as relative skill 1 or NA with a warning, and their absolute
    scores are returned unchanged (hubverse-org/hubEvals#75,
    hubverse-org/hubEvals#135).
  • Scoring on transformed scales with transform_append now returns one row
    per scale instead of silently averaging across scales
    (hubverse-org/hubEvals#122).
  • Oracle output is now read correctly from cloud (S3) hubs whose admin.json
    declares a non-parquet submission format such as csv. The cloud sync always
    writes model-output/ to parquet on S3 regardless of the declared format, so
    such hubs previously came back as an empty connection
    (hubverse-org/hubData#148).

Full Changelog: v1.1.1...v1.2.0

v1.1.1

Choose a tag to compare

@annakrystalli annakrystalli released this 17 Jun 11:26
v1.1.1
162d288

What's Changed

Full Changelog: v1.1.0...v1.1.1

v1.1.0

Choose a tag to compare

@annakrystalli annakrystalli released this 17 Jun 07:51
v1.1.0
30c6341

What's Changed

Full Changelog: v1.0.1...v1.1.0

v1.0.1

Choose a tag to compare

@nickreich nickreich released this 27 Jan 17:49
2eab801

What's Changed

  • fix: use DESCRIPTION file with explicit renv snapshot for reproducible dependency management by @annakrystalli in #14
  • update renv.lock in anticipation of adding a rounds_idx configuration property by @matthewcornell in #13
  • remove the build-image job's test step, which we think is causing build to fail in some cases by @matthewcornell in #15

New Contributors

Full Changelog: v0.1.0...v1.0.1

v0.1.0

Choose a tag to compare

@zkamvar zkamvar released this 16 May 16:44
v0.1.0
ab0f10e

What's Changed

  • Consolidate dockerfile, update renv, and add tests by @zkamvar in #11

Full Changelog: v0.0.1...v0.1.0

v0.0.1

Choose a tag to compare

@zkamvar zkamvar released this 15 May 19:47
v0.0.1
df80862

This represents the initial release of the versioned image