You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For some inputs dec64_sqrt can enter an infinite loop where it will not converge on a result and will instead oscillate between two values forever. It seems to be related to rounding behavior within dec64_divide. Printing both the coefficient and the exponent of progress, we get the following log from dec64_sqrt(dec64_make(36040, 0))
For some inputs
dec64_sqrt
can enter an infinite loop where it will not converge on a result and will instead oscillate between two values forever. It seems to be related to rounding behavior withindec64_divide
. Printing both the coefficient and the exponent ofprogress
, we get the following log fromdec64_sqrt(dec64_make(36040, 0))
The text was updated successfully, but these errors were encountered: