Symmetric Linear Quantization

[vinutah]

Hi,

The math for the derivation of y_q under Symmetric Linear Quantization on the page
https://nervanasystems.github.io/distiller/algo_quantization/index.html seems incorrect.
I am not able to reason out to myself, the scaling of the bias term.

Thanks

[guyjacob]

You're right, there is an error in the scale factor of the bias. It should be the reciprocal of the what's in there now. That is, it should be: (q_x * q_w) / q_b.
And actually, the parentheses are wrong as well - the way it is now it implies the bias is added during the accumulation instead of after it.

Will fix - thanks for spotting it!