Add support for OpenAI's GPT-4 turbo (gpt-4-1106-preview) model + GPT-4o + GPT-4o mini

[0xdevalias]

Since OpenAI released the GPT-4 Turbo model (gpt-4-1106-preview) and reduced the prices of GPT-4 at their recent dev day, it would be cool if this tool was able to support using those as well.

Further Reading

• https://openai.com/blog/new-models-and-developer-products-announced-at-devday
• https://platform.openai.com/docs/models

  • New models launched at DevDay

    We are excited to announce the preview release of GPT-4 Turbo (128k context window) and an updated GPT-3.5 Turbo (16k context window). Among other things, both models come with improved instruction following, JSON mode, more reproducible outputs, and parallel function calling.

• https://openai.com/pricing

  • Model	Input	Output
    gpt-4-1106-preview	$0.01 / 1K tokens	$0.03 / 1K tokens

See Also

• Replace gpt-3-encoder with gpt-tokenizer or similar #5

[0xdevalias]

A quick search of the repo suggest changes would need to be made to at least the following files:

• https://github.com/jehna/humanify/blob/main/src/index.ts#L38-L44
• https://github.com/jehna/humanify/blob/main/src/openai/openai.ts#L30

[jehna]

Yes, great point! I think it would make sense to even parametrize the model as a command line argument 🤔

[0xdevalias]

I think it would make sense to even parametrize the model as a command line argument

Yeah, I was thinking that too. Though maybe it can still have some 'friendly aliases' built in or similar so that the end user doesn't need to know the exact model name they need (specifically thinking about the current preview version of gpt-4-turbo in particular).

There are API's for querying the models available too, so if you wanted to get really fancy and not hardcode things, the CLI could potentially fetch the available models from that URL and cache them, then tell the user which ones could be used. Though that might be overkill.

[0xdevalias]

GPT-4o mini was announced today; ~60% cheaper than GPT-3.5 Turbo:

• https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/

  • GPT-4o mini scores 82% on MMLU and currently outperforms GPT-41 on chat preferences in LMSYS leaderboard(opens in a new window). It is priced at 15 cents per million input tokens and 60 cents per million output tokens, an order of magnitude more affordable than previous frontier models and more than 60% cheaper than GPT-3.5 Turbo