Optical Flow Module #2110
Replies: 3 comments 1 reply
-
Please go ahead. I think it would be a great benefit to have it. It would be the best to make them differentiable, along with some classic use cases, deep learning models, etc. Later on, we may wrap those methods to plug-and-use modules to ease the video understand applications like I3D or something more fancy stuff. |
Beta Was this translation helpful? Give feedback.
-
Definitely this is inside the project scope. Can we list what exact functionality we want to include so that we can organise in different issues? |
Beta Was this translation helpful? Give feedback.
-
@edgarriba yes sure, so my initial list of functions to be implemented would look like this:
From what I've seen, most flow papers are implementing these functions themselves. Having a unified implementation would facilitate easier usage of these "standard" techniques in new projects. |
Beta Was this translation helpful? Give feedback.
-
Hi Kornia team,
I would be interested in adding some optical flow functions. I have seen that there have been a few efforts made to implement some optical flow approaches (eg. #1465). However, before implementing some of the classical approaches (Lucas–Kanade etc.), adding some utilities, such as optical flow to rgb, interpolating flow, occlusion estimation, or full image warping (etc.) might be interesting and useful. I would be keen to implement some of the basic flow functionalities. Let me know what you think!
Beta Was this translation helpful? Give feedback.
All reactions