Skip to content

[Test] Nightly workflow for the ACTOR_TS_SKIP_FLAKY_MNS-quarantined suites #538

Description

@pathosDev

Use case

ACTOR_TS_SKIP_FLAKY_MNS=1 is set in all three workflows that run the unit suite (test.yml, multi-runtime.yml, publish.yml), which describe.skips three suites: tests/multi-node/lease-majority.test.ts, tests/multi-node/parallel-pubsub.test.ts, tests/unit/testkit/ParallelMultiNodeSpec.test.ts. There is no scheduled job that re-attempts them — they are permanently dark in CI, so a regression in these paths is invisible until someone runs the full suite locally. (bunfig.toml additionally strips them from the coverage denominator, hiding the quarantine twice.)

Proposed approach

  • A nightly workflow that runs exactly these three suites without the skip env, continue-on-error, with log capture — same pattern as the existing nightly integration jobs.
  • On repeated green runs, evaluate un-quarantining (the documented root cause is Bun-on-hosted-runner worker respawning, which may have been fixed by newer Bun releases).
  • Surface breach/regression as a workflow-summary annotation rather than a red PR check.

Acceptance criteria

  • Nightly job runs the three quarantined suites and uploads logs
  • A documented decision path for un-quarantining (N consecutive green nights)
  • README/AGENTS note stays accurate about what CI does and does not run

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requestinfrastructureCI / build / live-integration testspriority: mediumUseful, not urgentproduction-goalBlocks or defines the path to production readiness

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions