New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Floating point/rounding issue #6085

Closed
925dk opened this Issue Dec 5, 2016 · 1 comment

Comments

Projects
None yet
2 participants
@925dk

925dk commented Dec 5, 2016

See:

http://jsfiddle.net/68f9b056/1/

It seems tick mark values occasionally are being incorrectly rounded/calculated, resulting in values such as 0.00000000000000022 shown (or similar small values).

I'm guessing this is a recent regression, as I've never seen it before.

@jon-a-nygaard

This comment has been minimized.

Show comment
Hide comment
@jon-a-nygaard

jon-a-nygaard Dec 5, 2016

Collaborator

Thanks for reporting!

Internal Note: regression since 5.0.3
Since a606fc1
After adding 6 to multiples the resulting tickInterval will become 0.6000000000000001 when magnitude equals 0.1.

Collaborator

jon-a-nygaard commented Dec 5, 2016

Thanks for reporting!

Internal Note: regression since 5.0.3
Since a606fc1
After adding 6 to multiples the resulting tickInterval will become 0.6000000000000001 when magnitude equals 0.1.

@jon-a-nygaard jon-a-nygaard self-assigned this Dec 5, 2016

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment