Decoding a video frame, given the previous frame, current motion vectors, and current residual image.

[itoen220]

Assume we have pos_target=t, a reference frame at pos_target=t-1, and the motion vectors and residual image for the given pos_target=t. However, assume we don't have the original video file.

Given these constraints, I would like to reconstruct the frame at pos_target=t, as described in Equation 1 of your paper.

So far, I've tried decoding the frame at pos_target=t by: (1) creating a reference frame, which is just a copy of the t-1 frame; (2) performing motion compensation by copying 16x16 pixel blocks from the t-1 frame to the reference frame, based on the motion vectors; (3) adding the residual image to the motion-compensated reference frame.

This is the reference frame at pos_target=2:

This is the result after step (1), for pos_target=3:

This is the result after step (2), for pos_target=3:

The final result seems to have some compression artifacts, so I guess I'm not reconstructing the frame correctly. Is there a better way to do this (particularly, using ffmpeg)? Thanks!

[ffmpbgrnn]

Hi @itoen220 , do you have any updates on better reconstruction?

[AlexSte803]

@itoen220 Did you solve it? I have the same problem.

[shencuifeng]

@itoen220 Did you solve it? I have the same problem.

did you reconstruct it?