Cyclical video stutter with large Opus frame durations

[edde746]

Version

Media3 1.9.2

Devices that reproduce the issue

• Xiaomi Box S 2nd gen
• Samsung Z Flip (SM-F700F/DS)

Reproducible in the demo app?

Yes

Reproduction steps

1. Play attached media

Expected result

No stuttering

Actual result

Stuttering, dropped frames

Media

https://drive.google.com/file/d/1jQmvhHlqdg7Dkxa-uv0w_Pgifyj11MoY/view?usp=sharing

Additional information

Happens with large Opus frames, the example file has 120ms frames, issue does not happen with standard 20ms frames.

This might just be bad media, but some apps (specifically the Plex app, no, not transcoding) seems to have implemented a fix for this.

[microkatz]

@edde746

Thank you for providing the content. I was able to re-produce the "dropped frames" issue on my Pixel 6 device but I noticed a lot of errors with unexpected timestamp discontinuities.

I think there are some discontinuities in the audio timestamp positions of the audio packets in your file. That's causing the clock to jump around and forcing the player to drop video frames in order to "catch up". When I manipulated the player to not use the audio as the clock source(which I would not recommend. You want the audio to be the clock source for proper A/V Sync) then I don't get any stutters/dropped frames. When I remuxed your file using ffmpeg to fix the audio timestamp issues then I didn't get any dropped frames.

The player is working as intended. The player should drop video frames to keep up with A/V Sync with the audio. This is just bad media. I'm going to close this issue. If you have any additional questions then please re-open or create a new ticket. Thanks!

To note: if you were able to provide the requested bug report as per the template then I could see properly if you are hitting the same issue as I'm "reproducing".

[edde746]

Figured, if anyone stumbles upon this, this is the fix I ended up using: edde746/plezy@d207185