How to use this bert version to use the pretrianed model?

[Y-H-Joe]

Hi guys, thanks for great work. I'm trying to use this pytorch version protein-bert to use the pre-trained model 'ftp://ftp.cs.huji.ac.il/users/nadavb/protein_bert/epoch_92400_sample_23500000.pkl', but have no clues at all. Could you please give some suggestions? Thank you so much!

[ThorKlm]

Hi guys, I also wanted to ask, if either someone managed to load the weights from 'epoch_92400_sample_23500000.pkl' into the pytorch implementation of protein-bert, or if compatible weights of some pretraining could be officially provided on github to make experiments more replicative and comparable. This would be very helpful. Thanks in advance!