This model maxium context length is 8191 tokens - trown out of the program

[Blackbrain63]

⚠️ Search for existing issues first ⚠️

• I have searched the existing issues, and there is no existing issue for my problem

GPT-3 or GPT-4

• I am using Auto-GPT with GPT-3 (GPT-3.5)

Steps to reproduce 🕹

read text file that contains more characters that the 8191 tokes

Current behavior 😯

Python\Python311\Lib\site-packages\openai\api_requestor.py", line 682, in _interpret_response_line
raise self.handle_error_response(
openai.error.InvalidRequestError: This model's maximum context length is 8191 tokens, however you requested 8938 tokens (8938 in your prompt; 0 for the completion). Please reduce your prompt; or completion length.

Expected behavior 🤔

No response

Your prompt 📝

# Paste your prompt here

[E-Labs-io]

I have been getting this too. When it tried to read form a large file it doesn't break down into chunks before trying to process so seems that the GPT engineer rejects for being too large. Maybe a break to chunks function between read and injest/send to GPT

[marktsears]

Yes, getting the same and that is what is needed

[Pwuts]

Closing as duplicate of #2801

[GoMightyAlgorythmGo]

me to happened since the first days. Im on stable this is 90% if crashes. 3.5t Stable version

NEXT ACTION: COMMAND = search_files ARGUMENTS = {'directory': '.', 'query': 'cassandra_installation.sh'}
->
openai.error.InvalidRequestError: This model's maximum context length is 8191 tokens, however you requested 157088 tokens (157088 in your prompt; 0 for the completion). Please reduce your prompt; or completion length.
->
crash

[GoMightyAlgorythmGo]

endless crashes on 3.5gpt with search_files output too large for example 1000000 tokens intead of max allowed 8191 for output allowed

[Pwuts]

@GoMightyAlgorythmGo -> #2801