agents-realtime: WebRTC connection issue with large image inputs

[chollier]

Question

What are the specs for gpt-realtime image input? I've been having where my WebRTC data channel closes on me silently and I couldn't figure out what was wrong.. Until I drastically compressed the image I'm sending.

FWIW I was able to reproduce this with the realtime-next example and by adding the option to upload an image (rather than camera capture)

[seratch]

Thanks for sharing this and we're sorry for the confusion. The public document page for the parameter is this, but the document does not yet have clear guidance on the upper limit of the image data size. We'll work with the teams to set some requirements, but for now, please use smaller images like you're already doing.

[chollier]

Thanks! just wanted to flag it :)

[chollier]

btw I think it may be a WebRTC limitation rather than a model limitation but not 100% sure

[seratch]

Just a quick update on this: I've shared this feedback with the engineering team building this feature. So they're aware of the issue now. I cannot tell when this could be improved, but we may update you when I got some news from them.

[github-actions]

This issue is stale because it has been open for 7 days with no activity.

[github-actions]

This issue was closed because it has been inactive for 3 days since being marked as stale.