receiving reports of instability when scaling up with the SiLU based … …value gates. use the sigmoid gating from alphafold2 instead
receiving reports of instability when scaling up with the SiLU based … …value gates. use the sigmoid gating from alphafold2 instead