Model Parameter Not Functioning as Expected

[gormlabenz]

When using the command line interface for ChatGPT, the --model parameter seems to not be working as intended. When attempting to set the model to GPT-4, the application returns responses as if it were GPT-3.

Steps to Reproduce

1. Set the model to GPT-4 using the command:
   % gpt --model gpt-4 -p "Are you chatgpt-4?"
2. The response was:
   As an AI model developed by OpenAI, I'm currently based on GPT-3. As of now, GPT-4 has not been released.
3. Defining a new assistant in the config file and omitting the --model parameter yielded the same response.
   No, I'm an AI developed by OpenAI and currently known as ChatGPT-3. As of now, there is no ChatGPT-4.

Expected Behavior
The application should return responses as per the specified model in the command line or as set in the default assistant in the config file.
Actual Behavior
The application returns responses as if it were GPT-3, irrespective of the model set in the command line or the config file.

[kharvd]

gpt-4 might not know it’s gpt-4, that’s expected. Try comparing the latency of response with gpt-3.5-turbo

[VSharapov]

I was skeptical, especially since OpenAI's webUI seems to know which it is, but the code doesn't lie, and if that's not enough, then I think this is close enough to proof:

$  for model in gpt-3.5-turbo davinci-002 gpt-4 ; do echo $model; gpt --model $model --prompt "Give me a 20 word sentence about carrots where every word starts with the letter G." ; echo; done

gpt-3.5-turbo
Gorgeous, golden carrots grow generously in gardens, giving great gustatory gratification, garnishing gourmet dishes, gratifying gastronomes' gourmet desires.

davinci-002
ERROR:gptcli:Uncaught exception
Traceback (most recent call last):
[...snip...]
    raise ValueError(f"Unknown model: {model}")
ValueError: Unknown model: davinci-002

gpt-4
"Gardeners generally grow great golden gourds, generating generous gourmet gifts, glorifying gardens, gratifying gourmets, greatly gaining gastronomic gratitude globally."

[kharvd]

ChatGPT web ui knows which model it is because it's specified in its system prompt (which was leaked many times, you can find it online)