Skip to content

Bug 1830760 - For manifests selected with very high confidence (e.g. manifests with modified tests), run on all configs#6035

Merged
marco-c merged 1 commit into
mozilla:masterfrom
marco-c:select_configs_all
May 14, 2026
Merged

Bug 1830760 - For manifests selected with very high confidence (e.g. manifests with modified tests), run on all configs#6035
marco-c merged 1 commit into
mozilla:masterfrom
marco-c:select_configs_all

Conversation

@marco-c
Copy link
Copy Markdown
Collaborator

@marco-c marco-c commented May 14, 2026

Ideally we'd be smarted and e.g. run a modified tests only on all configs where the test actually runs, but I think this is still better than the current state.
The current algorithm uses history about previous failures, so if a test failed in the same way e.g. on Linux and Windows, it knows it can schedule on each independently. When a test or manifest is modified though, this assumption breaks because the failure mode could change.

…manifests with modified tests), run on all configs
@marco-c marco-c requested a review from suhaibmujahid May 14, 2026 09:38
@marco-c marco-c marked this pull request as ready for review May 14, 2026 09:38
Comment thread bugbug/models/testselect.py
@marco-c marco-c merged commit f1fca89 into mozilla:master May 14, 2026
6 checks passed
@marco-c marco-c deleted the select_configs_all branch May 14, 2026 14:37
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants