Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About image resolution and optical flow resolution #12

Closed
1129ljc opened this issue Aug 11, 2022 · 2 comments
Closed

About image resolution and optical flow resolution #12

1129ljc opened this issue Aug 11, 2022 · 2 comments

Comments

@1129ljc
Copy link

1129ljc commented Aug 11, 2022

I noticed that in the code './tool/video_inpainting. Py 'the resolution of the optical flow estimation for low-resolution images is extended, which causes the resolution to not align when the function rf.regionfill() is called.
if imgH < 350: flowH, flowW = imgH * 2, imgW * 2 else: flowH, flowW = imgH, imgW
After this code is deleted, the sample is generated accurately. Can the author explain the reason for this?v

@hitachinsk
Copy link
Owner

That may be a bug after refactor, I will check the details. The usage about these two lines is to estimate accurate optical flows. Since we adopt RAFT for flow estimation, we noticed the performance of deep learning-based optical flow estimation methods is related to the frame resolution. If the resolution is too low, the performance of flow estimation will degrade. Therefore, we enlarge the frame resolution when the resolution is too low.

@hitachinsk
Copy link
Owner

This bug is fixed, I impose the resize operations to optical flows in calculate_flow function in the code ./tool/video_inpainting.py.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants