Input is partially lost on submission

[andrewneilson]

Describe the bug

This has happened to me maybe 5 times in the last day and I think it might be new since 0.0.334.

I will type a prompt that might have just 2-3 sentences sometimes split across lines. When I submit the prompt, around half the message will get removed and the actual submission ends up being just the first line.

This is very unpredictable and has affected maybe 2% of my prompts.

Here is the most recent example that caused me to come write this. It's some monitoring that sends an AI summary to Slack, although I am paraphrasing part of it since the input was lost (which is the whole problem):

See monitor.js

    I got one of these errors in slack:

    :x: KPI Monitor Error
    API request failed with status 429: {"error":{"code":"RateLimitReached","message":"Rate limit of 160000 per 60s
    exceeded for UserByModelByMinuteTokens. Please wait 26 seconds before retrying.","details":"Rate limit of 160000
    per 60s exceeded for UserByModelByMinuteTokens. Please wait 26 seconds before retrying."}}

1. Rather than sending this type of error to Slack, let's keep it to the console
2. When this does happen, let's publish the raw data to Slack based on our significance threshold

When I submitted this, the whole bottom part (starting with "1. Rather...") was truncated. Other occurrences of this issue were very similar.

Affected version

0.0.334

Steps to reproduce the behavior

No response

Expected behavior

No response

Additional context

No response

[williammartin]

Oof this sounds bad @andrewneilson, thanks for creating the issue. Nothing obvious comes to mind right now but definitely we'll want to prioritise getting to the bottom of this. Any chance there's any other commonality when you experience this, like:

• Pasting in content?
• Multi line?
• Is it always content at the end that is lost?
• Does your message appear in full in the timeline, or is it cut off there as well?

[RyanHecht]

Potentially related: #208

[andrewneilson]

Pasting in content?

Not pasting Edit: the truncated part isn't pasted, but maybe the messages contain pasted content? Again not certain. My example in the description did have pasted content but it was not the truncated part.

Multi line?

Probably but can't say with certainty.

Is it always content at the end that is lost?

Yes

Does your message appear in full in the timeline, or is it cut off there as well?

No, it's cut off there too.

[macCesar]

Oof this sounds bad @andrewneilson, thanks for creating the issue. Nothing obvious comes to mind right now but definitely we'll want to prioritise getting to the bottom of this. Any chance there's any other commonality when you experience this, like:

• Pasting in content?
• Multi line?
• Is it always content at the end that is lost?
• Does your message appear in full in the timeline, or is it cut off there as well?

@williammartin ... To answer your questions in one go: all of the above! 😅

The message doesn’t appear in the timeline, nor when pressing the up arrow key to bring up the history.

Sometimes I drag a .php file into the prompt box, then write a few paragraphs, but only the file path gets sent, e.g. '/some-directory/some-other-directory/the-file.php'. 😤

[RobertSundling]

• Pasting in content?
• Multi line?
• Is it always content at the end that is lost?
• Does your message appear in full in the timeline, or is it cut off there as well?

@williammartin - I am seeing this very frequently, so much so that I reverted to 0.0.0332. (Probably could have gone to 0.0.0333 but I wanted to be sure.)

I have a sneaking suspicion that it is because of the new [Paste #1 - 15 lines] thing that was added in 0.0.334, where longer pasted text is replaced with short placeholder text (which IMHO is very annoying, because it doesn't let me edit the pasted text). I have seen my prompts being truncated particularly when pasting short text in a prompt. The truncation often seems to happen exactly at the end of a short piece of text that was pasted in.

Scrolling up in my prompt history in the timeline, the prompts are also truncated there, so I also can't recover my lost prompts. It doesn't seem to matter how much text there is after the bit that was pasted; I've lost a few words and I've lost a few paragraphs.

One thought was that I might be able to work around the problem by remembering to always paste some additional text at the very end of my prompt, since it might be after the last pasted text where it's a problem. (That was what I was considering trying next as a workaround, but I decided to just revert instead.)

[williammartin]

Thanks a lot for chiming in @RobertSundling, we have a PR opened about an hour ago around a bug exactly on short pastes so it's pretty great to have you drop by with some confirmation.

Re:

which IMHO is very annoying, because it doesn't let me edit the pasted text

I wonder if we need some kind of toggle here for whether the tokenization should be applied on paste (or can be toggled off after the fact). It's always going to be a challenge finding a perfect heuristic for how people want it to work. Our experience is that most of the time when people paste large bodies of text, it's just information for the LLM, and we can avoid a lot of rendering and UX pain by tokenizing it. I can definitely create a feature if you think a toggle of some kind would be handy.

[RobertSundling]

I wonder if we need some kind of toggle here for whether the tokenization should be applied on paste (or can be toggled off after the fact). It's always going to be a challenge finding a perfect heuristic for how people want it to work. Our experience is that most of the time when people paste large bodies of text, it's just information for the LLM, and we can avoid a lot of rendering and UX pain by tokenizing it. I can definitely create a feature if you think a toggle of some kind would be handy.

@williammartin, I definitely understand the reasoning of why you added the abbreviated paste thing. The toggle is a good idea. My preference might be for a hotkey (Ctrl+P for "Expand pasted" or something like that) which would expand pasted text to its full form and make it editable, sort of like how Ctrl+R lets you expand or collapse the responses. But adding such a toggle might be a lot of work, particularly if the expectation is that pressing it twice collapses things again. Expanding is easy, but collapsing might be tricky to get right, particularly if users edit text right at the clipboard boundaries.

Alternatively, simply adding a separate paste-as-editable hotkey (such as Ctrl+Shift+V) might also work. No toggle in that case, as you're choosing which mode to be in when you paste.

A global option to adjust the length threshold (in either lines or number of bytes bytes) would be good either way. (If I paste 200+ lines of text I'll probably never want to edit it inline, but 30 lines or less, quite possibly.)

[roperi]

In my case the truncation happens without any pasting involved. And it has happen several times since yesterday. So imagine that I'm typing this very same message and click on the green Comment button below.

Then, in the submitted prompt box, I'll only see the following:

""In my case the truncation happens without any pasting involved. "

Everything else is missing.

EDIT: The beginning of paragraph/sentence/word is always there. The missing parts are always the rest of the paragraph/sentence/word.

[skylar-anderson]

Thanks for reporting this and for your patience while we investigated the root cause. We've reproduced the bug and recently merged a fix that will go out in a fresh release later today. I also hear you @RobertSundling that providing an option to expand the paste tokens could be really useful. I'll bring that feedback back to the team.