You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If a dataset profile has logged values in a relatively tight range but are large in absolute value, and there are enough bins, the bin edge calculations can hit collisions because of numeric precision on the float values used.
This affects the conversion of the profile to a summary.
The text was updated successfully, but these errors were encountered:
mitigation in place to prevent errors due to bin width collisions, will follow up in next version to support calling a double version of the kll_sketch so we have closer to the expected precision coming from python floats.
Summary
If a dataset profile has logged values in a relatively tight range but are large in absolute value, and there are enough bins, the bin edge calculations can hit collisions because of numeric precision on the float values used.
This affects the conversion of the profile to a summary.
The text was updated successfully, but these errors were encountered: