Allow the user to pass `--retry 3` which should mean if a test fails, we try run it 3 more times to see if it passes.