Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Importance scores in the TVSum50 tsv file #19

Open
ayushkothari27 opened this issue Feb 19, 2020 · 3 comments
Open

Importance scores in the TVSum50 tsv file #19

ayushkothari27 opened this issue Feb 19, 2020 · 3 comments

Comments

@ayushkothari27
Copy link

Hello,
How should I interpret the importance scores in the tsv file of the original TVSum50 dataset?
Are they for each frame? If yes, what is the frame rate used?
What is the significance of a shot being of 2 seconds?

The data annotation file has importance scores for each video. The readme said that each shot is 2 seconds. Hence while going through the data for the 1st video (length 5 min 54 sec), the number of annotations provided was over 10000. I am not able to understand how the length of the video is related to the number of annotations. Multiplying each video duration with commonly used frame rates (24-30) doesn't help as well.

@weirme
Copy link
Owner

weirme commented Feb 20, 2020

I think each frame corresponds to a score in the tsv file. Assuming a frame rate of 30 frames per sec, the 1st video with a length of 5 min 54 sec (about 360sec) should have more than 10000 frames.

@SinDongHwan
Copy link

@aayushkothari11
first, you can get fps and duration time of each videos using "ffmpeg -i video.mp4"
fps of 1st video is about 29.97fps(about 30fps)
duration time is 05:53.64

second, importance scores are scores of each frames.
you can check a length of 1st video.
i checked using python. a length of importance scores of 1st video is 10,597.
therefore, number of frames of 1st video = (5*60 + 53) * 30 = 10,590

@ayushkothari27
Copy link
Author

ayushkothari27 commented Feb 20, 2020

@weirme @SinDongHwan
Even I thought the same with frame rate 30 fps but that only satisfying for some videos. After using ffmpeg, I came to know that some videos use 30 while some use 24 fps. Thank you for your help! Much appreciated.
Also is there any good way to convert video from these fps to 3 fps so that the importance scores of the frames can also be easily related.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants