[BUG]openai.error.ServiceUnavailableError: The server is overloaded or not ready yet.

[Lynnjl]

When I run the command: python3 -m revChatGPT.Official --api_key API_KEY --stream
the following error : penai.error.ServiceUnavailableError: The server is overloaded or not ready yet

[txtspam]

i got it also:

openai.error.RateLimitError: The server is currently overloaded with other requests. Sorry about that! You can retry your request, or contact us through our help center at help.openai.com if the error persists.

maybe they UP the model but doing a ratelimit. ? maybe openai dev is watching us here

[leolrg]

Same

[cateyelow]

same help me

[Lynnjl]

same help me

I revert to davinci-3 using export GPT_ENGINE="text-davinci-003". and the problem is fixed.

[txtspam]

same help me

heres the temporarily working Official.py solution but it costs you:

from
ENGINE = os.environ.get("GPT_ENGINE") or "text-chat-davinci-002-20221122"
to
ENGINE = os.environ.get("GPT_ENGINE") or "text-davinci-003"

from
ENCODER = tiktoken.get_encoding("gpt2")
to
ENCODER = tiktoken.get_encoding("p50k_base")

from
if response["choices"][0]["text"] == "<|im_end|>": break
to
if (response["choices"][0]["text"].strip() == "<|im_end|>" or response["choices"][0]["text"].strip() == "<|im"): break
find this in code:
Add request/response to chat history for next prompt
look for
<|im_end|>
then remove it and it would look like
"\n"

hopes it helps for a while

thanks and credits to
pengzhile
coolmian

[cateyelow]

text-davinci-003 is paid model. i have no money

[acheong08]

I don't either. Wait a while for the servers to recover from overload

[xjd-ziyu]

I don't either. Wait a while for the servers to recover from overload

It seems that the current official model is unstable and often affected by the official openai. I look forward to your unofficial browserless version. Thank you.

[siyuyuan]

I don't either. Wait a while for the servers to recover from overload

i have the same problem

openai.error.ServiceUnavailableError: The server is overloaded or not ready yet.

[txtspam]

same help me

heres the temporarily working Official.py solution but it costs you:

from ENGINE = os.environ.get("GPT_ENGINE") or "text-chat-davinci-002-20221122" to ENGINE = os.environ.get("GPT_ENGINE") or "text-davinci-003"

from ENCODER = tiktoken.get_encoding("gpt2") to ENCODER = tiktoken.get_encoding("p50k_base")

from if response["choices"][0]["text"] == "<|im_end|>": break to if (response["choices"][0]["text"].strip() == "<|im_end|>" or response["choices"][0]["text"].strip() == "<|im"): break find this in code: Add request/response to chat history for next prompt look for <|im_end|> then remove it and it would look like "\n"

hopes it helps for a while

thanks and credits to pengzhile coolmian

I don't either. Wait a while for the servers to recover from overload

i have the same problem

openai.error.ServiceUnavailableError: The server is overloaded or not ready yet.

Use this temporarily...

[siyuyuan]

same help me

heres the temporarily working Official.py solution but it costs you:
from ENGINE = os.environ.get("GPT_ENGINE") or "text-chat-davinci-002-20221122" to ENGINE = os.environ.get("GPT_ENGINE") or "text-davinci-003"
from ENCODER = tiktoken.get_encoding("gpt2") to ENCODER = tiktoken.get_encoding("p50k_base")
from if response["choices"][0]["text"] == "<|im_end|>": break to if (response["choices"][0]["text"].strip() == "<|im_end|>" or response["choices"][0]["text"].strip() == "<|im"): break find this in code: Add request/response to chat history for next prompt look for <|im_end|> then remove it and it would look like "\n"
hopes it helps for a while
thanks and credits to pengzhile coolmian

I don't either. Wait a while for the servers to recover from overload

i have the same problem
openai.error.ServiceUnavailableError: The server is overloaded or not ready yet.

Use this temporarily...

but it is costly :(

[hafidzaini]

so, no solution yet for this problem without paying? 😂

[ericzhou571]

Hi,

thanks for your solution. But why you change tokenizer to "p50k_base"? text-davinci-003 is supposed to be a gpt3.5 model, so does text-chat-davinci-002. Since text-chat-davinci-002, I think we should still use "gpt2" tokenizer right?
Maybe you have special reason to do so? It would be very nice if you could give more explain to this change.

Best
Erich

[seanhuangjf]

the same problem: openai.error.ServiceUnavailableError: The server is overloaded or not ready yet.

[faissaloo]

I'm getting the same thing

[hafidzaini]

is "text-davinci-002-render" could be real model name? anyone tried?

[leolrg]

is "text-davinci-002-render" could be real model name? anyone tried?

doesn't work

[acheong08]

https://github.com/acheong08/ChatGPT/releases/tag/2.0.0

[acheong08]

works now!

[myfingerhurt]

I think the text-davinci-003 is dumper than text-chat-davinci-002-20221122 and has more misleading information.

By the way text-chat-davinci-002-sh-alpha-aoruigiofdj83 is not working any more.

InvalidRequestError(message='That model does not exist', param=None, code=None, http_status=404, request_id=None)