Add weighted round-robin strategy #3929
l-lesetong
started this conversation in
Ideas
Replies: 1 comment
-
|
I think this feature would be useful as a first-class routing option, with a few explicit semantics so it works predictably with the existing scheduler:
Acceptance tests I would expect:
|
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently, subscription selection seems to use normal round-robin or equal distribution.
However, different subscriptions GPT may have different quotas, costs, performance, or stability. It would be useful to assign different weights to subscriptions so that traffic can be distributed proportionally.
Beta Was this translation helpful? Give feedback.
All reactions