intermittent failures

[tansaku]

are a real pain in CI - I wonder if we should replicate what @johnnymo87 set up for us on LocalSupport which is re-running any failed tests a second time to see if they are "real" failures ...

I note a few open issues covering specific intermittent fails:

#1084 #1078 #997 #995 #994

doing a re-run on individual failures seems a better practice than the omission strategy that we currently use, and the re-run should also mean it's easier to find the error messages in the semaphore logs ...

[tansaku]

here are the cucumber profiles on LocalSupport that make the rerun of failures possible: https://github.com/AgileVentures/LocalSupport/blob/develop/config/cucumber.yml the trick for WSO would be to make this all work for semaphore, but that shouldn't be a big deal ... hahahahahha

[tansaku]

@lara-t Simple,
@tansaku Medium,
@praveendhawan Simple

ah, so I'm the odd one out for that vote on test re-run

happy to concede to the majority

just noting we've never done it on semaphore before and it requires admin input

[tansaku]

restarting builds is burning time - must sort this ...