Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Motion resent101 #15

Closed
LiliMeng opened this issue Mar 14, 2018 · 4 comments
Closed

Motion resent101 #15

LiliMeng opened this issue Mar 14, 2018 · 4 comments

Comments

@LiliMeng
Copy link

Hi,
Thanks a lot for providing the open-source code!

     May I ask how did you get your pre-trained motion ResNet101? It's pre-trained on ImageNet and fine-tuned on UCF101 or the just changing the channels of the model trained on ImageNet? 
  
      Highly appreciate your time and help!
@jeffreyyihuang
Copy link
Owner

Hi,
Thanks for the good question!! I utilize the cross-modality pretraining technique to transfer the model weight pretrained on ImageNet to fit the motion ResNet101. The details are described in Readme!

Sincerely,
Jeffrey

@LiliMeng
Copy link
Author

Hi Jeffrey,

       Thanks a lot for your kind and quick reply. The channels in the RGB and optical flow stream are different, how did you fit the pre-trained ImageNet model to the optical flow stream? Do you have the code to load the ImageNet pre-trained model to optical flow stream? 

       Highly appreciate your time and help! 

@jeffreyyihuang
Copy link
Owner

Hi,
Please refer the link below to see my implementation details of cross-modality pretraining method!

https://github.com/jeffreyhuang1/two-stream-action-recognition/blob/master/network.py#L216

Jeffrey

@LiliMeng
Copy link
Author

Great! Thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants