Loop on a simple request

[paxvinci]

I made a simple request but in the end the demo application went in almost infinite loop.

[Harshit9926]

Write the first 500 characters of the Iliad epic poem, then stop.”
Or if you’re controlling the settings, set max_tokens=150. That tells the system “generate about 500 characters max, then cut it off.”
That’s it. Make the stopping rule clear and set a limit. The model won’t loop if it knows when to quit.​​​​​​​​​​​​​​​​