Skip to content

Conversation

@zurawiki
Copy link
Owner

@zurawiki zurawiki commented Mar 1, 2023

Also fix token limits

- Lower the prompt token limit for "text-davinci-003" and "text-davinci-002" to `4000`
- Lower the prompt token limit for "code-davinci-002" to `4000`
- Lower the prompt token limit for all other models to `4096`
- Move the OpenAI client initialization to a separate function

[src/llms/openai.rs]
- Lower the prompt token limit for "text-davinci-003" and "text-davinci-002" to `4000`
- Lower the prompt token limit for "code-davinci-002" to `4000`
- Lower the prompt token limit for all other models to `4096`
- Move the OpenAI client initialization to a separate function
@zurawiki zurawiki merged commit 7342c70 into main Mar 1, 2023
@zurawiki zurawiki deleted the minimal-diff branch March 1, 2023 20:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants