Why Norm Weight is before R_res.T?

[wowhao32]

To ensure that R_res is fused into the linear layer of the previous layer without affecting the results, shouldn't the RMSnorm weight $W_{norm}^i$ be fused into the next linear layer first?

[BrotherHappy]

为了保证全局旋转矩阵的等价性