Feature/add testing framework#59
Conversation
Adds a readme file which describes the Ocre testing framework, how to add new tests, and gives an example of valid config.json. Signed-off-by: Patrick Robb <probb@iol.unh.edu>
Add flash validation test cases, and remove placeholder testcases. Signed-off-by: Patrick Robb <probb@iol.unh.edu>
Signed-off-by: Evan Parker <eparker@iol.unh.edu> Signed-off-by: Patrick Robb <probb@iol.unh.edu>
827f133 to
2827fad
Compare
|
You can download an example of the testlog artifact here: https://github.com/project-ocre/ocre-runtime/actions/runs/14484551864 |
|
I'm running into some difficulty getting the tests.yaml workflow to run once the build.yaml workflow is complete. My latest commit adds the most common approach to doing this, which is "workflow_run," but I think the test.yaml file needs to exist on the main branch before the workflow_run trigger will work. But I'm not sure how we can merge that the tests.yaml file trigger is correct before merging this PR into main, so it's a bit of a catch 22. I created another PR just now which was making a pull request from ocre-runtime-my-fok/main to ocre-runtime/main to see if that would resolve the trigger issue, which is die not. I'm going to close that PR (#60) now, since it's stuck in the same place as this PR. |
* add CONFIG_OCRE_CONTAINER_MESSAGING check for cleanup subsystems * remove debug comment
Description
This PR adds the Ocre testing framework, along with the first test group (flash validation). The more detailed description of what is being added can be seen in /tests/README.md which is added on one of the commits on this PR.
Type of change
How Has This Been Tested?
I have run this testing framework and the intial test group (the flash validation test group) directly on the Ocre-Runtime GHA agent by SCP'ing my branch over to the host, and running 'bash beginTests.sh flashValidation' which is currently "working," in that the tests are reporting fails since the ocre-runtime currently on the DUT board is reporting errors. I will provide a section from the flash validation test log here for context.
Checklist: