PyTorch's replication of the model ProteinBERT.
A pretraining script, a training script and a pretrained model on UniRef90 and the most recent GO annotations.
ProteinBERT: a universal deep-learning model of protein sequence and function, Bioinformatics