Crash detection in build script is off-by-one #19703
Labels
area-testing
Unit tests, device tests
fixed-in-8.0.7
fixed-in-8.0.10
fixed-in-8.0.14
fixed-in-8.0.40
fixed-in-9.0.100-preview.1.9973
platform/windows 🪟
t/bug
Something isn't working
Milestone
Description
While looking at why the test crashing still allowed the test run to pass I noticed that we do actually check to see if the number of test categories matches:
Enable WinUI Controls Test Pipeline by PureWeen · Pull Request #17221 · dotnet/maui (github.com)
I made a debug build that prints out all the categories (Pipelines - Run 8.0.6-ci.net8.27224+pr.19697-sha.8a651754ae-azdo.104578 logs (azure.com)) which is 43 items, but the artifacts produced a build with only 42 xml files (it's missing
TestResults-com_microsoft_maui_controls_devicetests_Frame.xml
). You can also see it's missing from the test results page in ADO too (Pipelines - Run 8.0.6-ci.net8.27224+pr.19697-sha.8a651754ae-azdo.104578 (azure.com))Here's frame test showing up in a non-crashed build: Pipelines - Run 8.0.6-ci.net8.27199+pr.19682-sha.957f043dce-azdo.104513 (azure.com)
Steps to Reproduce
No response
Link to public reproduction project repository
No response
Version with bug
8.0.3
Is this a regression from previous behavior?
No, this is something new
Last version that worked well
Unknown/Other
Affected platforms
Windows
Affected platform versions
No response
Did you find any workaround?
No response
Relevant log output
No response
The text was updated successfully, but these errors were encountered: