Add polly style retry mechanism for http calls to inference services for integration tests

Our integration tests are not super reliable because of service timeouts and unreliable services (e.g. 500 responses).
We should add a polly style retry mechanism to the http clients we use for our inferences services when doing integration tests to automatically retry these types of failures.