Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error when displaying summary using gpt-3.5-turbo-16k #54

Closed
kickahaota opened this issue Jun 14, 2023 · 2 comments
Closed

Error when displaying summary using gpt-3.5-turbo-16k #54

kickahaota opened this issue Jun 14, 2023 · 2 comments

Comments

@kickahaota
Copy link

kickahaota commented Jun 14, 2023

When I chat using the new gpt-3.5-turbo-16k model, the "/sum" command does not appear to work correctly as the conversation starts to grow. The "Please wait" message appears, but then an error dialog is displayed with the following message:

sendButtonClickHandler error: Error: The specified values of `maxTokenCountOfSummary` and `messageTokensToConsumePerSummary` are such that the summarization process could go over this model's token limit.
at computeAndSaveThreadSummaryIfNeeded (https://josephrocca.github.io/OpenCharacters/:3511:19)
at async HTMLButtonElement.sendButtonClickHandler (https://josephrocca.github.io/OpenCharacters/:6291:65)

The tab then hangs until refreshed.

I don't have any way of debugging this here; but maybe this model choice code from line 3482 is no longer accurate? Maybe you need to use the gpt-3.5-turbo-16k model to summarize gpt-3.5-turbo-16k chats?

if(await threadIsUsingOpenAiModel(thread)) {
            modelName = "gpt-3.5-turbo"; // if they're using any OpenAI model, then we use turbo for summarization
}
@kickahaota
Copy link
Author

kickahaota commented Jun 14, 2023 via email

@josephrocca
Copy link
Owner

Thanks! I think this is fixed now - please ping me if you're still running into problems

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants