Skip to content

Nightbell 3.11.0

Choose a tag to compare

@riveerxd riveerxd released this 16 Sep 14:32
· 90 commits to master since this release

Nightbell can now watch a Prometheus stack. Point it at an exporter's metrics endpoint and it reads one series, filtered by label the way PromQL filters, and pages you when the value leaves the range you set. Point it at a Prometheus, Mimir, Thanos or VictoriaMetrics server and it runs your own PromQL and treats the query as the alert condition. Point it at an Alertmanager and it lists what is firing, worst first, with each alert's severity and how long it has been going.

You do not have to remember the metric name. "Browse this endpoint" reads the URL and lists what is actually exposed, with a filter box over it, showing the current value beside a name with one series and the labels that separate them beside a name with several. Picking one fills the field in, and fills the label filter too when there is only one series to pick.

Three things it refuses to be quiet about. A label filter that matches nothing fails the check, because a metric that has stopped being exported is not good news. A sample of NaN is never healthy whatever comparison you set, because NaN means the exporter had no reading rather than a reading of zero. And an alert whose severity Nightbell cannot rank comes through whatever severity floor you set, because hiding what it cannot rank would be hiding outages.

Basic auth covers Grafana Cloud, Mimir and a Prometheus behind a reverse proxy. Anything else, a bearer token or a tenant header, goes in the monitor's own headers. The password is masked where you type it, never printed on the detail screen, never written to the diagnostic log, and left out of an export unless you asked for secrets.

Separately: a dead network no longer counts as an outage. The check that confirms the network is alive before paging you only ever covered plain status monitors, so a page monitor or an https one could page from a garage with no signal. Page loads now report which half broke, a socket dying inside a TLS handshake is no longer read as a certificate being refused, and the urgent repeat asks the last real verdict rather than the last attempt.