Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

question for video retrieval #12

Closed
yangjax opened this issue Sep 5, 2018 · 1 comment
Closed

question for video retrieval #12

yangjax opened this issue Sep 5, 2018 · 1 comment
Labels

Comments

@yangjax
Copy link

yangjax commented Sep 5, 2018

hi, i am very interested in your work on image retrieval, and my question is how can i apply it to the video retrieval domains. there mainly two pints make me confused:
firstly, image retrieval take CNN as the feature extractor , and the CNN mainly trained with the classification loss on such cifar-10 or landmark dataset(Oxf5k), can it generalize to the actual video scenarios(usually are not landmark)? fine-tuning needed? and how?
secondly, how can i calculate the similarity between the query video and reference video, my method is dividing video into key frames and match the similar frames by extracting the frame features
can you give me some opinion. thanks!

@willard-yuan
Copy link
Owner

@yangjax Sorry for later reply. For video retrieval, I recommend you use frame-based method since video-based feature extraction is very time-consuming, and it's unacceptable for large-scale video dataset. The pre-trained imageNet feature extraction model is a good start, and you can use PQ method as the ANN index. To calculate the similarity between the query video and reference video, the post I wrote is very useful and it's very effective in real world application.

Thank you for your interest for my work.

This issue was closed.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants