test: retry’able node get

[jackfrancis]

Reason for Change:

Our most common E2E flake at present is node get operations returning unexpected results. This PR tolerates transient node get responses within a given retry timeout period.

Issue Fixed:

Requirements:

• uses conventional commit messages
• includes documentation
• adds unit tests
• tested upgrade from previous version

Notes:

[acs-bot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jackfrancis

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [jackfrancis]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[codecov]

Codecov Report

Merging #1987 into master will decrease coverage by <.01%.
The diff coverage is n/a.

@@            Coverage Diff             @@
##           master    #1987      +/-   ##
==========================================
- Coverage   76.71%   76.71%   -0.01%     
==========================================
  Files         135      135              
  Lines       20573    20557      -16     
==========================================
- Hits        15783    15770      -13     
+ Misses       3873     3871       -2     
+ Partials      917      916       -1