[bug] Hosted Gorilla: <Issue>

[assem1390]

Exception: Error communicating with OpenAI: HTTPConnectionPool(host='34.132.127.197', port=8000): Max retries exceeded with url: /v1/chat/completions (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0x7f0ec18dabf0>: Failed to establish a new connection: [Errno 111] Connection refused'))
Failed model: gorilla-7b-hf-v0, for prompt: I would like to translate from English to Chinese

[ShishirPatil]

Thanks for raising this @assem1390 We were having peak traffic beyond what our hosted service could serve. I think that is now resolved. Please let us know if you run into any issues. Thanks for trying out Gorilla!

[ward-nexum]

@ShishirPatil I'm getting the same issue today. Is the peak traffic still the issue?

[grexzen]

Same here, system is over capacity.

[ShishirPatil]

Hi @ward-nexum @grexzen thanks for flagging this. Yup. You guessed it. I have provisioned more GPUs. Hope this should be resolved. Thank you very much for understanding.