Downsides to "constant" backoff with rate limiters? #6762
-
|
The default rescheduling when violating a rate limit is (currently) which is a linear back-off strategy, which will help to spread out excess load. However, if you don't care about spreading that out and simply want to satisfy the limiter's requirements (e.g. only N concurrent operations at a time), is there any reason not to do something like that is, a "constant" back-off (not really constant as it's still fuzzed to prevent a wall of jobs, but you get what I mean). Presumably you'd want to increase the max reschedules if using a policy like this, but wondering if there are any other gotchas that I'm not seeing (e.g. too much stress on Redis). |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
It looks to me like your proposal does not ensure a minimum amount of time. The random number could be 0.001, leading to a millisecond-long "backoff". |
Beta Was this translation helpful? Give feedback.
that's fair, perhaps