Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature to convert videomae huge and small finetuned on kinetics and ssv2 added to the videomae to pytorch converter #22788

Merged

Conversation

sandstorm12
Copy link
Contributor

What does this PR do?

Adds the feature to convert VideoMAE huge and small to hugging face compatible pytorch model. The following models are added to the converter:

  1. VideoMAE huge fine-tuned Kinetics
  2. VideoMAE small fine-tuned Kinetics
  3. VideoMAE small fine-tuned SSV2

Who can review?

@NielsRogge

…l finetuned kinetics and ssv2 added to videomae to pytorch converter
@HuggingFaceDocBuilderDev
Copy link

HuggingFaceDocBuilderDev commented Apr 15, 2023

The documentation is not available anymore as the PR was closed or merged.

@sandstorm12 sandstorm12 force-pushed the feature/huge_small_videomae_converter branch from c3ed1de to 84647ee Compare April 15, 2023 23:53
Copy link
Contributor

@NielsRogge NielsRogge left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding! Would it be possible to upload the huge checkpoints to the hub under your personal user account? Then I'll transfer them to the appropriate organization.

@sandstorm12
Copy link
Contributor Author

sandstorm12 commented Apr 16, 2023

@NielsRogge Uploaded the huge-kinetics, small-kinetics, and small-ssv2 models to the HF model hub under the following names:

  1. sandstorm12/videomae-huge-finetuned-kinetics
  2. sandstorm12/videomae-small-finetuned-kinetics
  3. sandstorm12/videomae-small-finetuned-ssv2

Let me know if anything else is needed.

Copy link
Collaborator

@sgugger sgugger left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for your contribution!

@sgugger sgugger merged commit 4d10de5 into huggingface:main Apr 21, 2023
novice03 pushed a commit to novice03/transformers that referenced this pull request Jun 23, 2023
…ssv2 added to the videomae to pytorch converter (huggingface#22788)

* Feature to convert videomae huge finetuned kinetics and videomae small finetuned kinetics and ssv2 added to videomae to pytorch converter

* Reformat convert_videomae_to_pytorch using black

* Value exception added for the possible videomae model architectures
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants