New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[ML] Add retry logic for 500 and 503 errors for OpenAI #103819
[ML] Add retry logic for 500 and 503 errors for OpenAI #103819
Conversation
Hi @jonathan-buttner, I've created a changelog YAML for you. |
Pinging @elastic/ml-core (Team:ML) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, but should this fix also be backported to 8.12.1?
Thanks Dave, yeah you're right it should be backported. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
💚 Backport successful
|
* Retry on 500 and 503 * Update docs/changelog/103819.yaml
This PR adds retrying for 500 and 503 status codes received from OpenAI. In my testing on the cloud I've seen intermittent 500 and 503 failures that cause ingest via a reindex to fail.
The errors are described here: https://platform.openai.com/docs/guides/error-codes/api-errors