Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add unit test to compare histogram_quantile results with and without query sharding #6525

Merged

Conversation

zenador
Copy link
Contributor

@zenador zenador commented Oct 31, 2023

What this PR does

Adds a unit test from #6504 to ensure that the results from histogram_quantile with and without query sharding have no significant differences. Before the fix in prometheus/prometheus#13153 was vendored in #6766 , this unit test failed, now it passes.

Context: Mimir had a bug that sometimes occurs when summing (or other aggregation) the classic histogram (separate series per bucket) input into histogram_quantile, when query sharding on the input results in reduced precision which is normally insignificant, but may result in non-monotonicity in the histogram buckets.

Which issue(s) this PR fixes or relates to

N/A

Checklist

  • Tests updated
  • Documentation added
  • CHANGELOG.md updated - the order of entries should be [CHANGE], [FEATURE], [ENHANCEMENT], [BUGFIX]

@zenador zenador force-pushed the zenador/fix-prec-errors-query-sharding-hist-quantile branch from 887b4ed to ca13881 Compare November 23, 2023 14:01
@zenador zenador force-pushed the zenador/fix-prec-errors-query-sharding-hist-quantile branch from ca13881 to bdd8bfa Compare November 30, 2023 10:49
@zenador zenador changed the title Fix precision errors from query sharding in input to histogram quantile Add unit test to compare histogram_quantile results with and without query sharding Nov 30, 2023
@zenador zenador marked this pull request as ready for review November 30, 2023 13:52
@zenador zenador requested a review from a team as a code owner November 30, 2023 13:52
Copy link
Contributor

@dimitarvdimitrov dimitarvdimitrov left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Awesome, LGTM

@dimitarvdimitrov dimitarvdimitrov merged commit 4c655bf into main Dec 8, 2023
28 checks passed
@dimitarvdimitrov dimitarvdimitrov deleted the zenador/fix-prec-errors-query-sharding-hist-quantile branch December 8, 2023 14:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants