Azure is really bad at hosting OpenAI models. They CAN be fast, but they're very often not. Around 20% of the time, they're so slow it is unusable.
I made azure.t3.gg to actively measure and report just how bad things are.
t3dotgg/azure-bench
Folders and files
| Name | Name | Last commit date | ||
|---|---|---|---|---|