Skip to content

v1.0.1

Choose a tag to compare

@vinayprograms vinayprograms released this 18 Apr 23:52
· 38 commits to main since this release

Patch release — adds jitter to llm retry backoff.

Fixed

  • llm/retry: exponential backoff now applies full jitter (uniform in [0, backoff)). Without it, concurrent callers hitting the same rate limit retried in lockstep and re-collided on every attempt; with it, they spread and converge naturally.