You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I wonder know what is the reason behind the use of the unsigned symmetric quantization for both weight e activation?
For activation it can be understandable since the ReLU is well suited for one-tailed distributions, such as ReLU activations.
But what is the explanations for weights? the distributions that are roughly symmetric about zero.
Have you ever tried to change signed symmetric quantization for weight? What was the results? I tried but the results seem not been good!
The text was updated successfully, but these errors were encountered:
I wonder know what is the reason behind the use of the unsigned symmetric quantization for both weight e activation?
For activation it can be understandable since the ReLU is well suited for one-tailed distributions, such as ReLU activations.
But what is the explanations for weights? the distributions that are roughly symmetric about zero.
Have you ever tried to change signed symmetric quantization for weight? What was the results? I tried but the results seem not been good!
The text was updated successfully, but these errors were encountered: