Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add an interpolate_embeddings helper function #249

Open
DanTaranis opened this issue Dec 20, 2022 · 0 comments
Open

add an interpolate_embeddings helper function #249

DanTaranis opened this issue Dec 20, 2022 · 0 comments

Comments

@DanTaranis
Copy link

DanTaranis commented Dec 20, 2022

This library is awesome. However I want to pretrain on small patches and then transfer learn on larger images.
torchvision has a really great helper function for their vision transformer class :
interpolate_embeddings.

"""This function helps interpolating positional embeddings during checkpoint loading,
    especially when you want to apply a pre-trained model on images with different resolution.

it would be awesome if your library also had something like that :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant