Add retry to cluster generation for testing in hack folder

[todaywasawesome]

Signed-off-by: Dan Garfield dan@codefresh.io

Note on DCO:

If the DCO action in the integration test fails, one or more of your commits are not signed off. Please click on the Details link next to the DCO action for instructions on how to resolve this.

Checklist:

• Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this does not need to be in the release notes.
• The title of the PR states what changed and the related issues number (used for the release note).
• I've included "Closes [ISSUE #]" or "Fixes [ISSUE #]" in the description to automatically close the associated issue.
• I've updated both the CLI and UI to expose my feature, or I plan to submit a second PR with them.
• Does this PR require documentation updates?
• I've updated documentation as required by this PR.
• Optional. My organization is added to USERS.md.
• I have signed off all my commits as required by DCO
• [n/a] I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
• My build is green (troubleshooting builds).

There are three very small changes to the resource generation

1. Switch to helm upgrade --install incase there is an attempt at repair, not really important, just stylistically better.
2. Add a few more debugging messages
3. Add a retry to getting cluster credentials. This step fails pretty regularly just because the endpoint isn't quite ready yet.

[codecov]

Codecov Report

Base: 45.60% // Head: 45.60% // No change to project coverage 👍

Coverage data is based on head (de8eb06) compared to base (a765c14).
Patch has no changes to coverable lines.

Additional details and impacted files

@@           Coverage Diff           @@
##           master   #11067   +/-   ##
=======================================
  Coverage   45.60%   45.60%           
=======================================
  Files         237      237           
  Lines       28914    28914           
=======================================
  Hits        13185    13185           
  Misses      13913    13913           
  Partials     1816     1816           

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

[pasha-codefresh]

LGTM

[crenshaw-dev]

lgtm!