Skip to content

release: align test selection with CI and set a measured timeout #344

Description

@pengfei-threemoonslab

Problem

The release workflow runs the full test suite serially, including timing-sensitive perf tests, inside a 15-minute budget shared with qualification checks, audits, signing, and artifact work. CI already separates correctness tests from performance tests and uses parallel execution.

A release candidate should fail for deterministic correctness evidence, not shared-runner timing noise, and its timeout should come from a rehearsal measurement rather than an estimate.

Acceptance criteria

  • The release correctness suite uses the same supported parallelism as CI (currently -n auto).
  • Release excludes perf-marked tests; CI remains the merge-time enforcement point for latency budgets.
  • Adapter static-only tests remain covered in either the release correctness suite or an explicit prerequisite artifact.
  • The release timeout is set from observed release: add a non-publishing rehearsal path #355 rehearsal timings with documented headroom.
  • A workflow comment explains why CI and release test selections intentionally differ.
  • Tests guard the marker/parallelism contract so future workflow edits do not silently reintroduce perf gating or serial execution.

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1Next after P0; blocks other work or ships a misleading resultarea:releaseRelease pipeline, packaging, and safety qualificationbugSomething isn't working

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions