Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Typical/default tolerance values for "known" quantiles #6

Open
daluu opened this issue May 21, 2018 · 0 comments
Open

Typical/default tolerance values for "known" quantiles #6

daluu opened this issue May 21, 2018 · 0 comments

Comments

@daluu
Copy link

daluu commented May 21, 2018

I came across this from https://github.com/tsenart/vegeta, which at the moment follows the default tolerance values and known quantiles presented in the example docs https://godoc.org/github.com/streadway/quantile#example-Estimator.

Curious to how the typical/default tolerance values were determined for the known quantiles:

  • 50th percentile or median
  • 95th percentile
  • 99th percentile

and how to extrapolate that for other typical additional percentiles or known quantiles, for example 90th percentile is often another quantile or percentile of interest. This method of figuring out tolerance values would be helpful to figure out for given quantiles, X,Y,Z, how to figure out the tolerances for new quantiles A,B,C. (e.g. other percentiles like 25th, 75th, 80th, etc.).

In the case of 90th percentile (for vegeta), based on this project's comment // We know we want to query the 95th and 99th, with the 95th a little less accurately. and current known quantile tolerances (pattern), I came up with this remapping to fit in the 90th percentile, based on gut instinct. Is it reasonable?

quantile.Known(0.50, 0.01),
quantile.Known(0.90, 0.001),
quantile.Known(0.95, 0.0005),
quantile.Known(0.99, 0.0001),
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant