TransGAN code has some error

[zlwangustc]

Describe the bug
I found that the code was copied from the source author's code and some pytorch's code was transformed to paddle error.

To Reproduce
1:
VIT_custom.py line59

return input * paddle.rsqrt(paddle.mean(input ** 2, dim=2, keepdim=True) + 1e-8)

should be

return input * paddle.rsqrt(paddle.mean(input ** 2, axis=2, keepdim=True) + 1e-8)

2:
VIT_custom.py line88

class CustomAct(nn.Layer):
    """ CustomAct layer
    Custom act method set, defalut "gelu"
    """
    def __init__(self, act_layer):
        super().__init__()
        if act_layer == "gelu":
            self.act_layer = gelu
        elif act_layer == "leakyrelu":
            self.act_layer = leakyrelu
        else:
            self.act_layer = gelu

which

leakyrelu has not been defined

[lmk123568]

感谢关注PPViT，已经给rd反馈

[xperzy]

PR #55 has been merged. So I close this issue.