Add support for TEST_SKIP_AFTER_FAILURE_COUNT

[tdiesler]

Borrowed from maven surefire - count test failures and skip subsequent tests when failure count > $TEST_SKIP_AFTER_FAILURE_COUNT
The default is TEST_SKIP_AFTER_FAILURE_COUNT=3

This can significantly speed up validation of bad PRs

[squakez]

Not sure to understand this change request. Consider that when you're running in GH actions, each workflow would execute each test suite individually. For instance, it does make test-common. So, in such case, this new variable is never took in consideration. The only case where it can make sense here would be in the test-smoke. However, such a test is only executed at night time before nightly release, and, it only have 4 possible failures, so, we'd really skip almost nothing.

[tdiesler]

make test-smoke takes > 30min on my box. If something goes wrong at the beginning, it already safes quite some time when set to 1. We can expand this to the other test suites later, if wanted

[squakez]

make test-smoke takes > 30min on my box. If something goes wrong at the beginning, it already safes quite some time when set to 1. We can expand this to the other test suites later, if wanted

Okey, then, we better make the variable scope local to this specific action. Otherwise we can get mislead and think that this is a global scope and would affect all test suite executions.

[christophd]

How about a TEST_FAIL_FAST=true option so the test suite stops after the 1st failure. I don't see why somebody would be interested in stopping execution after >1 failing tests when asking for fast feedback.

[tdiesler]

In surefire, it defaults to 0. Folks set it higher to see e.g. "the first three failures"
Would you like to expand this to the other test suites i.e. if smoke fails, no need to execute the others?