Easy to exceed max input token in agent mode

[jiec-msft]

no longer occurs with the latest nightly, but the agent blocks very quickly due to long prompts and then aborts in the middle of processing and leaves behind corrupt files. -_-

Originally posted by jWeck-Software in #254

[jWeck-Software]

This happened when I told the agent to optimize a 1,7k long file.

The agent himself documented what he was doing the whole time and made the prompt say that he had exceeded the limit.
This has never happened to me with Junie from Jetbrains.

I provided the first request, then a error which happened, because the AI wrote its own query instead of using the querybuilder which already worked just fine.

Then I told him, it is a great idea to omit data records in a statistical evaluation by limit and paging.

This was followed by the limit message.

I then discarded all changes by copilot and gave Junie the same task.
Junie also had a problem, but never hit any limit and completed the task.

[4skl]

Having issues like it too on included models (GPT). I did read somewhere that the token limit was around 8k, while the model can handle way more cf : https://learn.microsoft.com/en-us/azure/ai-foundry/openai/quotas-limits?tabs=REST
If it's not possible to increase that limit, at least warn the user that his prompt will be too big for the context window and that he should generate a summary of the actual state to continue the work in a new chat session.

[MihaiCiprianChezan-chm1lud]

This appears to be a bug. In VS Code, the agent either prompts you to continue iterating when it reaches the token limit or displays "Summarizing conversation history...", indicating that it automatically compacts the history to stay within limits.

In contrast, the JetBrains plugin shows "Oops, the token limit exceeded. Try to shorten your prompt or start a new conversation."—which means that once the token limit is reached, the agent fails to continue regardless of user input, unless a new session is started.

This issue occurs even on a Enterprise Plan, which is extremely frustrating. Having the highest-tier corporate subscription should enable seamless agentic workflows, not result in abrupt failures due to implementation errors. The same flows and prompts do not trigger this error in VS Code, so it's clearly an issue specific to the JetBrains plugin implementation.

[eyupUK]

Having the same issue is too frequently shown now. really frustrating for a premium user particularly.

[almothafar-maf]

I reached to this so quick, I'm not sure what the issue, my request was simple as just write a unit test for a class.

In VSC:

And I have option to continue.

[jiec-msft]

Hi Guys, we have some enhancement to the prompt in latest nightly 1.5.58.13695-243-nightly, please give it a try

[eyupUK]

Hi Guys, we have some enhancement to the prompt in latest nightly 1.5.58.13695-243-nightly, please give it a try

Unfortunately, it did not fix the issue as of now, the same issue still occurs.