Skip to content
/ shared-azure-openai-tpm Public

This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.

License

MIT license
11 stars 7 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

Azure-Samples/shared-azure-openai-tpm

Error
Looks like something went wrong!

About

This example shows how a multitenant service can distribute requests evenly among multiple Azure OpenAI Service instances and manage tokens per minute (TPM) for multiple tenants.

Topics

kubernetes csharp azure openai asp-net-core asp-net gpt azure-container-registry aks rag azure-kubernetes-service azure-openai llm chatgpt azure-openai-service

Resources

Readme

License

MIT license

Code of conduct

Code of conduct
Activity
Custom properties

Stars

11 stars

Watchers

11 watching

Forks

7 forks
Report repository

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •  

Languages