Aggreggate Stats by ASG in Prometheus / Grafana

[brietaylor]

Actual Behaviour:

Desired Behaviour

Pretty graphs, with min/max/mean/median values, aggregated beautifully by auto scaling group.

How to get there

We need the prometheus node query tool to somehow add an "autoscaling_group" value to each instance. Then, we can create aggregated queries on these values in grafana, and use its styling features to create a min/max/average plot.

This should also take some load off of Grafana (making hundreds of queries), my laptop (rendering hundreds of lines), and put it on Prometheus, which is optimized for aggregating tons of data, and I think it includes features for caching and such.

[ababaian]

This is now complete.