0.4.21

add stop gradient to the rotations, as done for stability, as in the …

…paper and open sourced code

0.4.20

add rel pos emb

0.4.19

add recycling logic and some more cleanup

0.4.18

keep fixing

0.4.17

fix residual for attn

0.4.16

fixes

0.4.15

iterate on MLM

0.4.14

fit in masked-language-modeling loss for MSAs, not yet accurate to paper

0.4.13

fix gating and make axial naming less confusing

0.4.12

0.4.12