Reduce CI test matrix from 63 to 33 jobs - #479
Merged
Merged
Conversation
Full test coverage (1/2/4/8 ranks × 5 dirs) runs only for git install. Editable and pip install stages reduced to 2-rank smoke tests (5 jobs each) to verify the install mechanism works with basic distributed paths. Removes the sequential needs: chain so all stages run in parallel. Reduces total jobs from 63 to 33 and eliminates GPU starvation caused by the sequential dependency chain. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
github-actions
Bot
added
in-progress
Contributor
There was a problem hiding this comment.
Pull request overview
This PR updates the Iris CI workflow to reduce GPU queue contention by shrinking the editable/pip-install rank matrices to 2-rank smoke tests and allowing install stages to run in parallel.
Changes:
- Reduce
test-editableandtest-installmatrices from ranks 1/2/4/8 to 2-rank only (per test directory). - Remove the sequential
needs:chain sotest-git,test-editable, andtest-installcan run concurrently. - Add
timeout-minutes: 180totest-installto align with other stages.
Both test-editable and test-install now depend on test-git, but run in parallel with each other. This avoids wasting GPU time on broken commits while keeping the two smoke-test stages concurrent. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
mawad-amd
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
needs:chain (test-git → test-editable → test-install) so all three install stages run in parallel.timeout-minutes: 180totest-install(was missing, matching the other stages).Rationale
Analysis of the last completed main CI run showed:
needs:chain forced 63 jobs to run across 3 serial stages, multiplying wait time.Impact
Git install (production path) still gets full coverage across 1, 2, 4, and 8 ranks.
Test plan
main(run 23452528485 — all 63 jobs green)🤖 Generated with Claude Code