Pretrained model weights

[philippschw]

Thank you for sharing @lucidrains ! Really fantastic work. I watched Yanniks video on perceiver and this repo really helps to go one or two levels deeper and understand the paper.
However, for applying this new architecture to practical applications, most of us without 100s of TPUs at our disposal, require pretrained models on imagenet, audioset etc. Could anyone that has successfully trained the model, can share weights?

[Jogima-cyber]

Would be glad to have some weights for audio tasks as well!

[m3at]

Same as #34 you can find some pre-trained weights in the author's repo: https://github.com/deepmind/deepmind-research/tree/master/perceiver#colabs