You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I attempted to calculate the cost to raise a six-star operator from elite 2, level 37, to elite 2, level 69, with a base of 93 Currency Experience. If the on-hand LMD is entered at 83,908 or less, it displays a correct subtraction. If the on-hand LMD is 83,909 or higher, it seems to have some kind of rounding error, displaying the cost at (for example)
131071.70000000001 = 214980.7 - 83909
I've attached a screenshot of the error, and the settings that caused it. Error occurs in both Firefox and Chrome.
The text was updated successfully, but these errors were encountered:
A decimal is introduced because of the offset to the experience and then it has potential to create floating point math issues in the output.
Likely the easiest workaround would be to force single point output in the display variable gn like is already done for gs. (Embarrassingly I almost exclusively use GitLab so I'm unfamiliar with how this repo flow works or I'd make the commit myself) 😅
@op there's a lot of really great resources out there RE floating point math concerns like this. It's pretty handy to know from time to time.
I don't know what could possibly be causing this.
I attempted to calculate the cost to raise a six-star operator from elite 2, level 37, to elite 2, level 69, with a base of 93 Currency Experience. If the on-hand LMD is entered at 83,908 or less, it displays a correct subtraction. If the on-hand LMD is 83,909 or higher, it seems to have some kind of rounding error, displaying the cost at (for example)
![image](https://user-images.githubusercontent.com/47841053/120566634-a9451e00-c3dd-11eb-8d87-436761644d67.png)
131071.70000000001 = 214980.7 - 83909
I've attached a screenshot of the error, and the settings that caused it. Error occurs in both Firefox and Chrome.
The text was updated successfully, but these errors were encountered: