Handle retry logic in data api builder

[Aniruddh25]

[yorek]

My suggestion for this is to use Polly.Net https://github.com/App-vNext/Polly. I'll check with CELA if that's ok to use, but the license seems to be pretty easy and extensive

[yorek]

here's an example, along with a list of transient error codes you may want to use: https://github.com/yorek/azure-sql-db-samples/tree/master/samples/02-resilient-connections/dotnet/automatic

[seantleonard]

FYI, since .NET 7 GA's in November -> .NET 7 is introducing native rate limiting middleware: https://docs.microsoft.com/en-us/aspnet/core/performance/rate-limit?preserve-view=true&view=aspnetcore-7.0

If we intend to heavily use rate limiting functionality of Polly, we should keep in mind that we can reduce usage of additional dependencies by going native in the future.

[JelteF]

For postgres there doesn't seem to be an official list specifically of transient errors, but the official list. The official list of all error codes can be found here: https://www.postgresql.org/docs/current/errcodes-appendix.html

And someone on stackoverflow made a list of error codes that they thought were transient, which at least looks as a good starting point: https://stackoverflow.com/questions/42822348/how-to-tell-from-npgsql-exception-if-the-call-is-worth-a-retry-transient-fault

[ayush3797]

For postgres there doesn't seem to be an official list specifically of transient errors, but the official list. The official list of all error codes can be found here: https://www.postgresql.org/docs/current/errcodes-appendix.html

And someone on stackoverflow made a list of error codes that they thought were transient, which at least looks as a good starting point: https://stackoverflow.com/questions/42822348/how-to-tell-from-npgsql-exception-if-the-call-is-worth-a-retry-transient-fault

I agree, the list in the stack overflow article looks to be a good starting point.