Add option to exit with exit code 1 when no tests are executed

[localheinz]

This PR

• adds a failOnEmptyTestSuite option which - when set - will fail a test run when no tests were found

Fixes #4313.

💁‍♂️ I have tried adding an end-to-end test, but I'm unsure how to assert the exit code from a .phpt test. Is that even possible?

Disabled

Enabled

[codecov]

Codecov Report

Merging #4314 into master will decrease coverage by 0.04%.
The diff coverage is 63.63%.

@@             Coverage Diff              @@
##             master    #4314      +/-   ##
============================================
- Coverage     84.65%   84.60%   -0.05%     
- Complexity     4569     4579      +10     
============================================
  Files           257      257              
  Lines         11500    11520      +20     
============================================
+ Hits           9735     9747      +12     
- Misses         1765     1773       +8     

Impacted Files	Coverage Δ	Complexity Δ
src/TextUI/CliArguments/Builder.php	79.95% <50.00%> (-0.30%)	113.00 <0.00> (+1.00)	⬇️
src/TextUI/CliArguments/Configuration.php	68.37% <50.00%> (-0.31%)	333.00 <86.00> (+4.00)	⬇️
src/TextUI/CliArguments/Mapper.php	79.35% <50.00%> (-0.39%)	77.00 <0.00> (+1.00)	⬇️
src/TextUI/TestRunner.php	63.65% <66.66%> (+0.01%)	221.00 <0.00> (+3.00)
src/TextUI/XmlConfiguration/Loader.php	98.07% <100.00%> (+<0.01%)	149.00 <0.00> (ø)
src/TextUI/XmlConfiguration/PHPUnit/PHPUnit.php	95.69% <100.00%> (+0.07%)	76.00 <10.00> (+1.00)

---

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 684e172...6ee76f7. Read the comment docs.

[localheinz]

Thank you, @sebastianbergmann!