-
Notifications
You must be signed in to change notification settings - Fork 215
Minimal mp_radix_size_overestimate, very large error #368
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
With an additional 8 bit precision for the cost of a 65 bytes large table plus alignment, one bigint, one Not 100% tested yet, only every |
89ed034 to
31fbb95
Compare
1e1315f to
8fef549
Compare
7c9f8f3 to
594c1ee
Compare
|
What is the maximal error? 28? Then this version looks pretty good. |
No, not 28, it is a bit more: twenty eight thousand three hundred and twenty eight. With the extra 8 bit precision it is probably lower than ~200 digits (no full test run done yet). |
|
The dot confused me. But we are talking integers so :P. This is out of question then. |
|
@czurnieden since we both agree on #371, I think it is ok to close this. |
This is the version with a large error range
-0,+x(withx < 28,328)PR slicing as asked for in #343
EDIT: corrected sign for thousands separator.