Skip to content

feat: rerun experiments if API says so#3258

Open
mikewilli wants to merge 4 commits into
mainfrom
holdback-analysis-rerun
Open

feat: rerun experiments if API says so#3258
mikewilli wants to merge 4 commits into
mainfrom
holdback-analysis-rerun

Conversation

@mikewilli

@mikewilli mikewilli commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

For experiments tagged by the Experimenter API with do_rerun:

  • trigger a rerun via rerun_config_changed
  • block the rerun if experiment tables have been updated more recently than do_rerun_timestamp
  • only run overall analysis
  • skip regular runs

@mikewilli mikewilli marked this pull request as ready for review June 17, 2026 18:56
@mikewilli mikewilli requested a review from scholtzan June 17, 2026 18:56
halemu pushed a commit to halemu/experimenter that referenced this pull request Jul 1, 2026
… model and v8 API (mozilla#16096)

Because

- Holdback experiments need to be flagged in Experimenter and re-run by
downstream analysis. Jetstream reads these fields from the v8 API to
decide when to rerun an experiment, and metric-hub uses them for
long-term holdback analysis.

This commit

- Adds `is_holdback`, `do_rerun`, and `do_rerun_timestamp` fields to the
`NimbusExperiment` model and exposes them in the v8 API as `isHoldback`,
`doRerun`, and `doRerunTimestamp`.
- Updates the v8 serializer and changelog serializer test expectations
and regenerates the OpenAPI schema and Swagger docs.

Related

- mozilla/metric-hub#1502
- mozilla/jetstream#3258

fixes mozilla#16087

---------

Co-authored-by: Yashika Khurana <yashikakhurana@Yashikas-MBP.home.local>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant