-
Notifications
You must be signed in to change notification settings - Fork 84
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Behaviour of AVG and Q.AVG? #38
Comments
i can definitely see that as being desirable! On Thu, Apr 14, 2016 at 10:05 AM, Sam Doshi notifications@github.com
|
In the PR, AVG -32767 -32768 == -32767 and AVG 32766 32767 == 32767, which is "round up" not "round away from zero". |
AVG -32767 -32768 == -32767 AVG 32767 32766 == 32767
GNU C round() goes away from zero. |
let's do that then.
…On Tue, Sep 12, 2017 at 11:29 AM, Poindexter Frink ***@***.*** > wrote:
GNU C round() goes away from zero.
—
You are receiving this because you commented.
Reply to this email directly, view it on GitHub
<#38 (comment)>, or mute
the thread
<https://github.com/notifications/unsubscribe-auth/AAPEcPHiD77jlMHoUHrgnUy2KVPg_j0aks5shpXrgaJpZM4IHZvU>
.
|
At the moment
AVG
andQ.AVG
perform integer division when calculating the average.e.g.
Should they round instead?
The text was updated successfully, but these errors were encountered: