Take MoE fused op from `bf16 @ (int4 --> bf16) = fp32` to `(bf16 --> int8) @ (int4 --> int8) = int32`
Take MoE fused op from
bf16 @ (int4 --> bf16) = fp32to
(bf16 --> int8) @ (int4 --> int8) = int32