Repository navigation
Releases
Releases · hubverse-org/hubPredEvalsData-docker
v1.3.0
Dependencies
Refreshed renv.lock to pull the latest releases of the hubverse packages the
image wraps, hubPredEvalsData 1.2.0 -> 1.3.0 and hubEvals 0.3.1 -> 0.5.0,
together with scoringutils 2.2.0 -> 2.3.0 and the other CRAN dependencies as
of the 2026-10-05 CRAN snapshot (#51).
The user-visible changes these bring to the generated dashboard data:
- Relative-skill scoring is substantially faster and uses much less memory,
which matters most on hubs with many models, such as FluSight. Relative
skill values are unchanged (hubverse-org/hubEvals#144,
epiforecasts/scoringutils#1221). - The number of predictions scored (
n) inscores.csvnow counts only
forecasts that had a corresponding observation to score against, rather
than every submitted prediction. This corrects an overcount wherever a
model submitted predictions for units with no observation. In the rare
case where this count differs across a target's output types,scores.csv
reports a separaten_<output_type>column per output type in place of
the singlen(hubverse-org/hubPredEvalsData#19). - Hubs whose target is identified by
target_idalone, with no target key
task id variable (target_keys: null), as used by nowcast hubs, are now
supported. Previously these failed partway through the run
(hubverse-org/hubPredEvalsData#87). - Evaluation data generation is faster on every hub: the hub connection is
opened once and reused across targets and evaluation sets
(hubverse-org/hubPredEvalsData#82).
Base and dev images
- Refreshing
renv.lockwithscripts/update.Rnow moves the CRAN
dependencies to their current releases together with the hubverse
packages. Previously CRAN packages stayed at the versions the rocker base
image was built against, so a hubverse release that required a newer CRAN
package could not be picked up (#51).
v1.2.0
Dependencies
Refreshed renv.lock to pull the latest releases of the hubverse packages the
image wraps: hubPredEvalsData 1.1.1 -> 1.2.0, hubEvals 0.2.0 -> 0.3.1,
hubUtils 1.2.0 -> 1.2.1, and hubData 2.2.1 -> 2.2.2 (#47).
The user-visible changes these bring to the generated dashboard data:
predevals-options.jsontargets now carrytarget_nameandtarget_units,
read from the hub's tasks config. The dashboard usestarget_nameto label
target menu items (hubverse-org/hubPredEvalsData#21).scores.csvrows are now sorted on the(model_id, by)key before writing,
so the file is byte-stable across runs. Output can be diffed or
md5-compared to confirm a no-change situation
(hubverse-org/hubPredEvalsData#25).- Models scored only on a later output type are no longer silently dropped
fromscores.csv. The per-output-type score frames are now merged with a
full join rather than a left join anchored on the first output type, so
which models survived no longer depends on the order metrics happen to be
listed in the config (hubverse-org/hubPredEvalsData#75). - Relative-skill scoring no longer aborts the run on single-model input, or
on disaggregated comparison groups that cannot be compared. Such groups are
reported as relative skill1orNAwith a warning, and their absolute
scores are returned unchanged (hubverse-org/hubEvals#75,
hubverse-org/hubEvals#135). - Scoring on transformed scales with
transform_appendnow returns one row
per scale instead of silently averaging across scales
(hubverse-org/hubEvals#122). - Oracle output is now read correctly from cloud (S3) hubs whose
admin.json
declares a non-parquet submission format such ascsv. The cloud sync always
writesmodel-output/to parquet on S3 regardless of the declared format, so
such hubs previously came back as an empty connection
(hubverse-org/hubData#148).
Full Changelog: v1.1.1...v1.2.0
v1.1.1
What's Changed
- Post-release: set development version (1.1.0.9000) by @annakrystalli in #41
- Release v1.1.1: pull hubPredEvalsData 1.1.1 (as_of fix) by @annakrystalli in #43
Full Changelog: v1.1.0...v1.1.1
v1.1.0
What's Changed
- Add dev Docker images and r-universe update workflow by @annakrystalli in #21
- Limit build-container.yaml pull_request trigger to production paths by @annakrystalli in #26
- Replace :latest diff CI with testthat output tests by @annakrystalli in #28
- Pin R 4.5 and refresh renv.lock with released versions by @annakrystalli in #29
- Split CI workflows and base production on shared base image by @annakrystalli in #32
- Refactor create-predevals-data.R into thin orchestrator (#6, #22) by @annakrystalli in #36
- Finalise v1.1.0 release by @annakrystalli in #40
Full Changelog: v1.0.1...v1.1.0
v1.0.1
What's Changed
- fix: use DESCRIPTION file with explicit renv snapshot for reproducible dependency management by @annakrystalli in #14
- update renv.lock in anticipation of adding a rounds_idx configuration property by @matthewcornell in #13
- remove the
build-imagejob'steststep, which we think is causing build to fail in some cases by @matthewcornell in #15
New Contributors
- @matthewcornell made their first contribution in #13
Full Changelog: v0.1.0...v1.0.1