-
Notifications
You must be signed in to change notification settings - Fork 195
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Specular reflective surfaces #44
Comments
Hi @bhack, yes, we also plan to release a model that will be trained on all available datasets. |
Probably a light segmentation component it could help in the model to understand what we are tracking with the grid allocation in cluster tracks. |
Is the released cotracker2 checkpoint trained on all available datasets? @nikitakaraevv |
Hi @nnop, we found that performance does not always improve when training on different datasets. This is because the model already exhibits strong synthetic-to-real generalization, and additional synthetic datasets do not necessarily make it better. We're trying to figure out a way to improve the model with more data. |
@nikitakaraevv probably you could explore any recent active learning approach to select new synthetic or real useful data samples. |
The performance on the well known ambiguous specular reflective surfaces are really not good also on light reflective surfaces. Often it is tracked the reflected content and the occlusion logic seems to be off.
Do you plan to improve this with synthetic data like pointodyssey?
The text was updated successfully, but these errors were encountered: