Retry 503 OpenAI errors

[waynehamadi]

Background

#4744
it needs to be an internal PR

Changes

Documentation

Test Plan

PR Quality Checklist

• My pull request is atomic and focuses on a single change.
• I have thoroughly tested my changes with multiple different prompts.
• I have considered potential risks and mitigations for my changes.
• I have documented my changes clearly and comprehensively.
• I have not snuck in any "extra" small tweaks changes.
• I have run the following commands against my code to ensure it passes our linters:

  black .
  isort .
  mypy
  autoflake --remove-all-unused-imports --recursive --ignore-init-module-imports --ignore-pass-after-docstring autogpt tests --in-place

[Auto-GPT-Bot]

You changed AutoGPT's behaviour. The cassettes have been updated and will be merged to the submodule when this Pull Request gets merged.

[codecov]

Codecov Report

Patch coverage: 73.87% and project coverage change: +20.11 🎉

Comparison is base (cd8fdb3) 50.90% compared to head (1fead30) 71.02%.

Additional details and impacted files

@@             Coverage Diff             @@
##           stable    #4745       +/-   ##
===========================================
+ Coverage   50.90%   71.02%   +20.11%     
===========================================
  Files          65       71        +6     
  Lines        2976     3537      +561     
  Branches      504      563       +59     
===========================================
+ Hits         1515     2512      +997     
+ Misses       1336      852      -484     
- Partials      125      173       +48     

Impacted Files	Coverage Δ
autogpt/cli.py	0.00% <0.00%> (ø)
autogpt/commands/web_playwright.py	0.00% <0.00%> (ø)
autogpt/singleton.py	100.00% <ø> (ø)
autogpt/speech/eleven_labs.py	28.57% <14.28%> (-0.85%)	⬇️
autogpt/main.py	22.36% <22.22%> (+22.36%)	⬆️
autogpt/speech/say.py	36.66% <25.00%> (ø)
autogpt/commands/audio_text.py	30.76% <26.66%> (+30.76%)	⬆️
autogpt/processing/text.py	36.44% <33.66%> (+16.13%)	⬆️
autogpt/configurator.py	30.37% <41.02%> (+30.37%)	⬆️
autogpt/utils.py	62.62% <47.61%> (-4.44%)	⬇️
... and 52 more

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

[krrishdholakia]

Hey @merwanehamadi

Have you looked at wrapping the base openai call with reliableGPT? Might be helpful here

from reliablegpt import reliableGPT
openai.ChatCompletion.create = reliableGPT(openai.ChatCompletion.create, ...)

Source: https://github.com/BerriAI/reliableGPT