Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About temporal stability #2

Closed
eastOffice opened this issue Jun 23, 2019 · 2 comments
Closed

About temporal stability #2

eastOffice opened this issue Jun 23, 2019 · 2 comments

Comments

@eastOffice
Copy link

Hi there,

I noticed that since davis 2017, temporal stability has not been one of the evaluation metrics. Would you mind telling the reason? Since it seems to be an important aspect and a numeric metric is desired.

Thanks

@eastOffice
Copy link
Author

I see the reason here now. However, temporal stability is only supported in davis16's repo, could you support it in this version?

@scaelles
Copy link
Member

scaelles commented Jun 25, 2019

Hello,
As stated in the link that you mentioned, temporal stability is not easy to measure when objects in the videos undergo severe occlusions. In DAVIS16, the measure was only computed on a subset of video sequences for that reason and we decided to drop it in DAVIS17. This repository only supports DAVIS17 evaluation and therefore including the temporal stability measure is not in our plans. If you would like to compute it, I would suggest that you use the matlab repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants