You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The results displayed in the Run Summary are inconsistent, probably due to the program counting the number of retires in the Total Tests count.
This also seems to affect the Slack integration report, where a failed test is counted each time a retry is executed, and the total number of tests will be artificially increased.
In the below example image, we can see that the number of passed and failed tests is correct, but the total number of tests is miss-calculated.
The issue is propagated a bit differently in the Slack report, where the number of failed tests is higher, as it considers all the failed retries of each test as well, instead of counting just the end result.
How to reproduce
Force-fail some tests in a run recorded in sorry-cypress, with retries turned on; this should be the only required element.
The text was updated successfully, but these errors were encountered:
Summary
The results displayed in the Run Summary are inconsistent, probably due to the program counting the number of retires in the Total Tests count.
This also seems to affect the Slack integration report, where a failed test is counted each time a retry is executed, and the total number of tests will be artificially increased.
In the below example image, we can see that the number of passed and failed tests is correct, but the total number of tests is miss-calculated.
The issue is propagated a bit differently in the Slack report, where the number of failed tests is higher, as it considers all the failed retries of each test as well, instead of counting just the end result.
How to reproduce
Force-fail some tests in a run recorded in sorry-cypress, with retries turned on; this should be the only required element.
The text was updated successfully, but these errors were encountered: