docs: add distro pre-filter documentation - #4591
Merged
Merged
Conversation
✅ AI Test Selection — PASSED4 test case(s) selected (view run) Marketplace image: suse sles-15-sp6-arm64 gen2 latest
Test case details
|
Contributor
There was a problem hiding this comment.
Pull request overview
This PR adds documentation for the distro-based test case pre-filtering feature and expands test selection behavior to incorporate a test maturity model (including a default “stable gate”), plus related schema/constants and selftests.
Changes:
- Add new end-user docs page for distro pre-filtering and link it from the docs index.
- Introduce maturity levels and a
maturityrunbook criterion; apply an implicit “stable gate” during selection (including marking OpenVMM suites aspreview). - Extend selftests to validate maturity filtering and stable-gate behavior.
Reviewed changes
Copilot reviewed 10 out of 10 changed files in this pull request and generated 6 comments.
Show a summary per file
| File | Description |
|---|---|
| selftests/test_testsuite.py | Extends the selftest helper to accept pre-built case metadata for selector tests. |
| selftests/test_testselector.py | Adds selftests covering maturity criterion behavior and the implicit stable gate. |
| lisa/util/constants.py | Adds constants for maturity criterion and supported maturity levels. |
| lisa/testsuite.py | Adds maturity metadata at suite and case levels, with inheritance from suite → case. |
| lisa/testselector.py | Implements maturity matching and an implicit stable gate; adds logging around stable-gate decisions. |
| lisa/schema.py | Adds the maturity criterion to the runbook schema and validates allowed values. |
| lisa/microsoft/testsuites/openvmm/openvmm.py | Marks the OpenVMM suite as preview maturity. |
| lisa/microsoft/testsuites/openvmm/openvmm_tests.py | Marks the OpenVMM upstream vmm_tests suite as preview maturity. |
| docs/index.rst | Links the new distro pre-filter documentation page. |
| docs/distro_pre_filter.rst | Adds comprehensive documentation for OS-based pre-filtering and selection flow. |
Document the OS-based test case pre-filtering feature
johnsongeorge-w
force-pushed
the
johgeorg/docs_distro-pre-filter
branch
from
July 9, 2026 20:40
86a04b6 to
887bca6
Compare
LiliDeng
approved these changes
Jul 10, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Document the OS-based test case pre-filtering feature