You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Has a section about floating point arithmetic that appears to be able to support our use case of arbitrary precision. Research the methods there to see if we can improve performance more.
The text was updated successfully, but these errors were encountered:
It implements an int10 type that is just a []uint8, with one digit per member. This clearly wastes memory, but critically it also wastes lots of CPU during add, since it has to add one digit at a time. It may make sense to use 1000 per digit instead of 10.
https://members.loria.fr/PZimmermann/mca/mca-cup-0.5.9.pdf
Has a section about floating point arithmetic that appears to be able to support our use case of arbitrary precision. Research the methods there to see if we can improve performance more.
The text was updated successfully, but these errors were encountered: