Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Blackbox exporter failures are not being reported properly #2684

Closed
Shubham-Sakhuja-Bose opened this Issue May 8, 2017 · 2 comments

Comments

Projects
None yet
2 participants
@Shubham-Sakhuja-Bose
Copy link

Shubham-Sakhuja-Bose commented May 8, 2017

What did you do?
Setup blackbox-exporter and set prometheus to point to it
What did you expect to see?
Prometheus to report failures on blackbox-exporter check failures
What did you see instead? Under which circumstances?
blackbox-exporter does properly fail on checks (see logs in below section) but prometheus does not recognize these failures
screen shot 2017-05-08 at 1 27 51 am
Environment

  • Prometheus version:

    base docker image: prom/prometheus:v1.6.1
    base docker image: prom/blackbox-exporter:v.0.5.0

  • Prometheus configuration file:

blackbox config.yml:

modules:
  http_get_2xx:
    prober: http
    timeout: 5s
    http:
      method: GET
      no_follow_redirects: false
  • Logs:
    from blackbox logs:
2017-05-08T05:27:52.650983679Z time="2017-05-08T05:27:52Z" level=warning msg="Error for HTTP request to http://broker.svc-data-broker-feature-libraries.svc:80/health: Get http://broker.svc-data-broker-feature-libraries.svc:80/health: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" source="http.go:166" 
2017-05-08T05:28:22.653027841Z time="2017-05-08T05:28:22Z" level=warning msg="Error for HTTP request to http://broker.svc-data-broker-feature-libraries.svc:80/health: Get http://broker.svc-data-broker-feature-libraries.svc:80/health: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" source="http.go:166" 
2017-05-08T05:28:52.654994461Z time="2017-05-08T05:28:52Z" level=warning msg="Error for HTTP request to http://broker.svc-data-broker-feature-libraries.svc:80/health: Get http://broker.svc-data-broker-feature-libraries.svc:80/health: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)" source="http.go:166"
@grobie

This comment has been minimized.

Copy link
Member

grobie commented May 8, 2017

Please ask usage questions on the prometheus-users@ mailing list. This is not a bug (check probe_success, the up metric only tells whether the blackbox_exporter itself is available.

@grobie grobie closed this May 8, 2017

@lock

This comment has been minimized.

Copy link

lock bot commented Mar 23, 2019

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.

@lock lock bot locked and limited conversation to collaborators Mar 23, 2019

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
You can’t perform that action at this time.