[v10] Refresh remote cluster connection status periodically

[andreiko]

Backport #22455 to branch/v10

[codingllama]

Looks like there's no api/utils/retryutils in v10, you may have to backport that too.

For reference:

• https://github.com/gravitational/teleport/commits/master/api/utils/retryutils
• https://github.com/gravitational/teleport/commits/branch/v11/api/utils/retryutils

(Edit: sent too quickly.)

[rosstimothy]

Looks like there's no api/utils/retryutils in v10, you may have to backport that too.

For reference:

• https://github.com/gravitational/teleport/commits/master/api/utils/retryutils
• https://github.com/gravitational/teleport/commits/branch/v11/api/utils/retryutils

(Edit: sent too quickly.)

Should just be able to use utils/retry.go

[codingllama]

I suggest backporting all the relevant PRs, so we don't end up in some in-between state here.

[rosstimothy]

I suggest backporting all the relevant PRs, so we don't end up in some in-between state here.

The rest of v10 is using utils.NewSeventhJitter so I don't see the problem in doing so here too. If we do pull just the retryutils changes from the relevant PRs into v10 I think a separate PR would probably be best.

[andreiko]

Pushed an update to use utils.NewSeventhJitter 43b7dc6

It's already used a couple times in the same runPeriodicOperations() function so it seems acceptable:
https://github.com/gravitational/teleport/blob/43b7dc6deb3a433c4ef863b844b0636003b6badf/lib/auth/auth.go#L459-L466