Skip to content

Split slow preflight test groups - #5045

Merged
mattp-fly merged 8 commits into
masterfrom
agent/split-slow-preflight-groups
Aug 6, 2026
Merged

Split slow preflight test groups#5045
mattp-fly merged 8 commits into
masterfrom
agent/split-slow-preflight-groups

Conversation

@mattp-fly

Copy link
Copy Markdown
Contributor

Summary

  • run TestDeploy in a dedicated deploy-fixtures matrix job
  • run TestPostgres_FlexFailover in a dedicated postgres-flex-failover matrix job
  • keep broad deploy and postgres matching for future tests while excluding only the isolated cases
  • build the grouped go test invocation with an argument array so optional flags are passed safely

Why

Recent scheduled preflight runs repeatedly hit the 15-minute package timeout in the deploy and postgres groups. The slow tests start after several other integration tests have already consumed much of that shared budget; postgres flex failover can also spend several minutes retrying cluster creation.

Giving those tests independent jobs preserves the existing timeout as a safety cap while preventing unrelated tests in the same package from exhausting their runtime.

Example failure: https://github.com/superfly/flyctl/actions/runs/30874868531

Validation

  • bash -n scripts/preflight.sh
  • parsed .github/workflows/preflight.yml
  • dry-ran group routing for deploy, deploy-fixtures, postgres, and postgres-flex-failover (including PR -short mode)
  • go test -tags=integration -run '^$' ./test/preflight/...

@mattp-fly
mattp-fly marked this pull request as ready for review August 6, 2026 19:26
@mattp-fly
mattp-fly merged commit 31de2be into master Aug 6, 2026
@mattp-fly
mattp-fly deleted the agent/split-slow-preflight-groups branch August 6, 2026 19:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant