[Bug]: Limit prompt length, output length, context length etc

[gufengc]

Steps to Reproduce

input long prompt doesn't get response

Expected Behavior

N/A

Actual Behavior

N/A

Version

main

Environment & Context

• I'm using the latest version.
• I have searched existing issues.