Calc: calculation error with decimal number

[jrlacharnay]

Hello,

When entering the following calculation: "500.10-400", the displayed result is not "100.10" as expected, but "100.10000000000002".

My version:

10:16:14.390 Keypirinha 2.8 (246eefb) for x64
10:16:14.390 Portable mode.
10:16:14.390 System: WinNT-x64 10.0.10586-ws-0x0300

Thanks!
Jean-Rémy

[jrlacharnay]

[polyvertex]

A way to deal with that would be for the Calc package to offer a "rounding" option so the user can specify the number of digits displayed after the separator by asking Calc to round it. This is something that can be added to a future release.

FYI and if that is of any interest to you, for now the displayed value is computed by the embedded Python interpreter and returned as-is by the Calc plugin. Python itself is dependent, at least partly, on the way the CPU deals with floating point arithmetic.

[ThaSiouL]

here is an updated calc version by myself that deals with the issue (among others)
Calc.zip
(Updated version from the version I posted in #70 and #93 )

EDIT by @polyvertex: @ThaSiouL has published its contribution in a GitHub repository

[ThaSiouL]

including .ini decimal sign

[polyvertex]

The Calc package has been greatly improved and released with v2.9.