Page: https://prometheus.io/docs/practices/histograms/
Describe the issue:
I have been trying to display otel histogram data in prometheus.
I don't know the best way of displaying the information so it is clear when there is a problem.
I thought one way would be to display the percentage of figures in each bucket
I tried
sum(rate(traces_span_metrics_duration_milliseconds_bucket[1m])) by (le)
/
sum(rate(traces_span_metrics_duration_milliseconds_count[1m])) * 100
but that produces no data
I tried
sum(rate(traces_span_metrics_duration_milliseconds_bucket[1m])) by (le)
/
sum(rate(traces_span_metrics_duration_milliseconds_bucket{le="+Inf"[1m])) * 100
but this also produces no data.
It would be great if you could give some examples of promql queries to plot histogram data, in histogram, or heatmap pictures.
My data is from OTEL so I have records from about 20 spans .... each with a LE histogram. I'd like to know the best way to display this data as well.
Page: https://prometheus.io/docs/practices/histograms/
Describe the issue:
I have been trying to display otel histogram data in prometheus.
I don't know the best way of displaying the information so it is clear when there is a problem.
I thought one way would be to display the percentage of figures in each bucket
I tried
sum(rate(traces_span_metrics_duration_milliseconds_bucket[1m])) by (le)
/
sum(rate(traces_span_metrics_duration_milliseconds_count[1m])) * 100
but that produces no data
I tried
sum(rate(traces_span_metrics_duration_milliseconds_bucket[1m])) by (le)
/
sum(rate(traces_span_metrics_duration_milliseconds_bucket{le="+Inf"[1m])) * 100
but this also produces no data.
It would be great if you could give some examples of promql queries to plot histogram data, in histogram, or heatmap pictures.
My data is from OTEL so I have records from about 20 spans .... each with a LE histogram. I'd like to know the best way to display this data as well.