Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chatgpt output word limit #66

Closed
vernon2gh opened this issue Mar 11, 2023 · 9 comments
Closed

chatgpt output word limit #66

vernon2gh opened this issue Mar 11, 2023 · 9 comments

Comments

@vernon2gh
Copy link

pipe input/output, but output word too much, once can not be output completed, how to continue to output the previous content? Or in Chat mode (set config.conversation_first true), the ability to pipe the input file so that we can type 'continue' to let chatgpt continue typing before ?

@sigoden
Copy link
Owner

sigoden commented Mar 11, 2023

gpt-3.5-turbo has a maximum limit of 4096 tokens, and currently there is no way to surpass this limit.

Can only wait for the release of new models or restrictions to be lifted.

@vernon2gh
Copy link
Author

If in Chat mode (set config.conversation_first true), the ability to pipe the input file so that we can type 'continue' to let chatgpt continue typing before.

The chatgpt web(https://chat.openai.com/chat) is able to do this.

@sigoden
Copy link
Owner

sigoden commented Mar 11, 2023

The only reason the stream has ended but the output hasn't finished is due to the max_tokens limit.

It's the same with or without conversation.

There is no chatgpt like continue in aichat/gpt3.5-turbo.

@vernon2gh
Copy link
Author

yeah, I get this.

Can you add the ability to pipe the input file in Chat mode, so we can type 'continue' to let chatgpt continue typing before(When the stream has ended but the output hasn't finished).

@sigoden
Copy link
Owner

sigoden commented Mar 11, 2023

You can copy from messages.md.

@vernon2gh
Copy link
Author

No, not fetch the output, is importing a large file

@sigoden
Copy link
Owner

sigoden commented Mar 11, 2023

Why not use command mode?

cat input.txt | aichat <tell ChatGPT how to handle file>

If you insist on using chat mode, you can use { to enable multi-line mode, and then you can directly paste the content.

@vernon2gh
Copy link
Author

cat input.txt | aichat

The output word too much, once can not be output completed, I need touch 'continue' manually in Chat mode.

@sigoden
Copy link
Owner

sigoden commented Mar 11, 2023

I don't think aichat/gpt-3.5 will interrupt prematurely before using up 4096 tokens.

If a request/conversation has no more output, it means either the response is completed or the token has run out.

No continue in aichat/gpt-3.5

@sigoden sigoden closed this as completed Mar 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants