Point at part of an image or video frame when replying to an agent

[Dwite]

The problem

Agents often send back screenshots, generated images, and screen recordings. When one small part is wrong, I have to describe where it is in words: "the button in the top right, under the header". This is slow, and the agent often picks the wrong spot.

T3 Code can already cite part of an agent's text with a comment. It cannot do the same for an image.

What I would like

A way to mark part of an image and send it with a comment:

1. Open an image in the preview and choose Cite.
2. Drag over the part I mean.
3. Add a short comment. This is optional.
4. The composer gets a cropped image, followed by my comment.

The crop is a normal image attachment. Every provider gets it the same way as a pasted image. It needs no server or contract change.

Possible steps

Each step would be its own PR. I would only do a later step if you want it.

1. Web and desktop: cite a region from the image preview.
2. Mobile: the same, from the long-press menu on an image.
3. Video: pause a video and cite a region of the frame on screen.

What I am asking

• Is this a direction you want for T3 Code?
• If yes, which steps are in scope? I am happy to do step 1 only.

I built all three before asking, which was my mistake. The PRs are closed, but they have screenshots and recordings that show how it could look: #13377 (web), #13378 (mobile), #13379 (video).

Related: #13873 asks for region captures with comments in PDFs.

[fagnersales]

That would be a great addition because agents nowadays mostly suck at UI, so being able to quickly iterate would be very nice!