Skip to content

Improve throttling handling: respect and expose retry-after value #1629

Closed
@waldekmastykarz

Description

@waldekmastykarz

Currently, genaiscript handles throttling situations, but it does not use the retry-after value returned by services to determine how long to wait before retrying. This can lead to unnecessary load on the service and suboptimal user experience.

Expected improvement:

  • When throttled, genaiscript should respect the retry-after value and wait accordingly before retrying.
  • The retry-after value should be exposed to the user so they are aware of the wait time and the reason for the delay.

This will help reduce service load and make the retry logic clearer and more transparent to users.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions