Feature request [allow to configure RPM, TPM, RPD, TPD] #1846
alexxtaurus83
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
It will be great if during model\api\provider configuration we can configure model RPM, TPM, RPD, TPD.
And after at Management UI we can see progress bar if we reached specific limit or not. I know some oauth model has built in limit feature. But for example qwen coder cli - not. Also Groq, Mistral, Open router has RPM, TPM, RPD, TPD. Based on user level. So if user can provide this data manually he can track usage. App already tracking usage just need to show additional graph at management UI. And also backend need to support new config params and expose it via rest api for UI.
All reactions