Closed
Description
Currently, genaiscript handles throttling situations, but it does not use the retry-after
value returned by services to determine how long to wait before retrying. This can lead to unnecessary load on the service and suboptimal user experience.
Expected improvement:
- When throttled, genaiscript should respect the
retry-after
value and wait accordingly before retrying. - The
retry-after
value should be exposed to the user so they are aware of the wait time and the reason for the delay.
This will help reduce service load and make the retry logic clearer and more transparent to users.
Metadata
Metadata
Assignees
Labels
No labels