-
Notifications
You must be signed in to change notification settings - Fork 43
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Processing images from video #9
Comments
Hi @bhack we are preparing for this and should be available in next version. |
Do you have just another planned version or paper? |
yes we are planning to release a new version of (a) a hugging face demo that can run on arbitrary input videos and (b) training script. The new version will also reduce the gpu usage by half |
Do you will have also an option to mask non rigid pixels in video mode? |
E.g. like the clustering in https://littlepure2333.github.io/GFlow/ |
@jytime So is there something available in the new V2? |
In the case currently we cannot autocluster/classify rigid and non rigid points can you at least support an init mask on the dynamic parts in the tracker? |
Hey, Currently, we do not have an update on the video processing feature as we are focusing on improving memory efficiency, as the mem problem seems to bother many people. Regarding non-rigid pixels, you have two options: (a) Avoid using non-rigid points as query points. You can achieve this by passing a mask to the get_query_points() function Line 453 in 8c47df8
or (b) set all non-rigid points as non-visible, such as done at: Line 236 in 8c47df8
All the non-visible will be ignored during triangulation. |
What kind of mask density this is going to require over a sequence? How many query you are preparing? |
any schedule to release the version of processing video ? |
Hi I am doing it now. I am comparing different methods to filter out dynamic objects in the videos. One potential solution is something like @bhack mentioned above. I am also comparing the off-the-shelf motion segmentation methods. Let's see which will win. |
Yes I've shared other fresh resources and comments in the other issue #24 (comment) |
Thanks for sharing these all. A lot of distractions recently. Hope I can do my best to share it as soon as possible. |
Is there any specific setting to take advantage of images from video sequences?
The text was updated successfully, but these errors were encountered: