Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

NP.times(9999999999999.46, 100) #6

Closed
ericxyly opened this issue Oct 31, 2017 · 3 comments
Closed

NP.times(9999999999999.46, 100) #6

ericxyly opened this issue Oct 31, 2017 · 3 comments

Comments

@ericxyly
Copy link

ericxyly commented Oct 31, 2017 •
edited
Loading

NP.times(9999999999999.46, 100) ==> 999999999999945.9

13位9

The result is not equal to 999999999999946
@camsong
Copy link
Member

camsong commented Oct 31, 2017 •
edited
Loading

This is because we got 99999999999994600 when computing, which is larger than Math.pow(2, 53) = 9007199254740992, so the result is not reliable. Right now I'm thinking of a work around for this case. But this library can not handle big numbers very well since the limitation of JavaScript native number.

@ascoders
Copy link

This library does not make scene with large numbers.

@ericxyly
Copy link
Author

ericxyly commented Nov 3, 2017

thanks

@ericxyly ericxyly closed this as completed Nov 3, 2017
@keller0 keller0 mentioned this issue Oct 8, 2018
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@camsong @ascoders @ericxyly