Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Doubts about data sources for text modal #18

Open
XYI-xue opened this issue Apr 17, 2024 · 2 comments
Open

Doubts about data sources for text modal #18

XYI-xue opened this issue Apr 17, 2024 · 2 comments

Comments

@XYI-xue
Copy link

XYI-xue commented Apr 17, 2024

Hi author, I would like to ask how you got the transcribed text corresponding to the videos in the SumMe and TVSum datasets? Was it created manually or did you use an existing model?I am very much looking forward to your answer.

@boheumd
Copy link
Owner

boheumd commented Apr 20, 2024

Hi, you can refer to the implementation details section in the main paper. For the SumMe and TVSum dataset, we adopt the pre-trained image caption model GPT-2 to generate the caption for each frame.

@XYI-xue
Copy link
Author

XYI-xue commented Apr 24, 2024

Hi, you can refer to the implementation details section in the main paper. For the SumMe and TVSum dataset, we adopt the pre-trained image caption model GPT-2 to generate the caption for each frame.

Thank you very much for your reply! I would also like to ask, how did you obtain the original video data in the data set? I looked at the dataset file you provided and found that it only has relevant feature values ​​for each video. Could you please provide the link or file where I can obtain the original video data that can be played?
Thanks for your help and looking forward to your reply.(☆▽☆)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants