DataTestMethod DynamicData test results not updated in Test suit #1001
Description
Description
After updating MSTest.TestAdapter, MSTest.TestFramework to 2.2.7 from 2.2.3 -> Data driven test results are not updated in test suit when triggered through Visual Studio Test - Task Version 2 (CICD pipeline)
before posing this I did go through the related issues in #910
But all these were related to test did not discovered or test not ran.
Issue
The data driven tests are running in the pipeline as expected and All Iterations in the test is reporting pass/fail status in pipeline logs and
.trx file is generated with expected result.
Test Outcome is still showing as inprogress
CICD vstest2 task is marked as completed even an iteration is failed (only happens with data driven tests)
All data driven tests stuck in - in progress status.
Earlier if any of the Iteration failed, vstest2 task shown as failed, but now its marked as green (completed)
I posted it in dev community
https://developercommunity.visualstudio.com/t/data-driven-test-result-not-updated-vstestv2/1547752
.trx has expected result:
If all iterations passed
ResultSummary outcome="Completed">
Counters total="6" executed="6" passed="6" failed="0" error="0" timeout="0" aborted="0" inconclusive="0" passedButRunAborted="0" notRunnable="0" notExecuted="0" disconnected="0" warning="0" completed="0" inProgress="0" pending="0" /
/ResultSummary
if few iterations failed
ResultSummary outcome="Failed"
Counters total="6" executed="6" passed="3" failed="3" error="0" timeout="0" aborted="0" inconclusive="0" passedButRunAborted="0" notRunnable="0" notExecuted="0" disconnected="0" warning="0" completed="0" inProgress="0" pending="0" /
/ResultSummary
But the test fail/pass is not updated in the test suit.
Expected behavior
Test Output status should be updated to Passed or Failed
Actual behavior
Test Outcome status stuck in - in progress