Manual Test Plan #441
Merged
Manual Test Plan #441
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
… test plans Some test routines can not yet be easily automated in Avocado, and for those, we rather test things manually then not at all. The idea behind this tool is to use a predefined test plan (a simple JSON file) that has test names and descriptions with how to perform the test and what to expect. The tool will ask for the results for each test (either PASS, FAIL or SKIP) and possibly additional notes. These results will then be saved to a JSON file or to a human readable report. The human readable report can, for instance, be part of a release commit message, or if preferred, the JSON result file can be committed to keep track of what is working and what is known to be broken at a given time. Signed-off-by: Cleber Rosa <crosa@redhat.com>
This is an example test plan of what could/should be run before the release of a new avocado version. Signed-off-by: Cleber Rosa <crosa@redhat.com>
|
Wow, this is awesome work. I'm going to try on my machine in a bit. |
|
👍 |
|
Yep, that looks good, thanks @clebergnu ! |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR introduces a very simple tool to help with manual test plans, a collection of tests that can not (yet) be easily automated in avocado but are very important to have done once in a while.
The test plan itself, provided as an example that can turn into our official release test plan, is a WIP as there's room for many more important manual tests.