Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Alert filtering by labels doesn't work #21

Open
mfuhrmann opened this issue Apr 12, 2018 · 12 comments
Open

Alert filtering by labels doesn't work #21

mfuhrmann opened this issue Apr 12, 2018 · 12 comments
Labels

Comments

@mfuhrmann
Copy link

mfuhrmann commented Apr 12, 2018

  • Grafana 4.6.3
  • Prometheus Alertmanager Plugin 0.0.4

I have some labels as you can see here:
grafik

When I try a filter expression like context="PSP-T" still all alarms are visisble in Grafana. Also a filter like instance="IP-ADDRESS" which should only hit one single alarm is not working.
I always get all alarms.

@SPFZ
Copy link

SPFZ commented Apr 12, 2018

It probably helps if you post an screenshot of how exactly your are querying the alertmanager (metrics section of the configuration).

@mfuhrmann
Copy link
Author

grafik

@SPFZ
Copy link

SPFZ commented Apr 12, 2018

Looks about right for me, are you 100% sure the context label is present in the alert? Can you put it in the legend to check?

@mfuhrmann
Copy link
Author

Not sure what you mean. This one https://user-images.githubusercontent.com/4995222/38625039-e3c96562-3da9-11e8-8315-5e3e209b6d60.png is a screenshot of alertmanager which shows that I have the context labels, for example context="PSP-T". Unfortunately the second screenshot https://user-images.githubusercontent.com/4995222/38673880-deb64154-3e52-11e8-9cb6-cf8b254705fd.png is an other example which uses context="IT". Sorry, but I didn't have an other one at this moment.

@davidferdinand
Copy link

I am also having the same issue. I can display all my current alerts on the table.
If one has a product table of test and i put product='test' in to the query box, it doesn't seem to do anything... in fact i cant get any query to work.
saying that the lable field works and its still great being able to display all my alerts...

@cryptobioz
Copy link
Member

Could you open the "query inspector" and check if your label is set under response -> data -> 0 -> labels?

@davidferdinand
Copy link

yep, its under that, but it just doesn't seem to do anything...

@mfuhrmann
Copy link
Author

grafik

@federico-razzoli
Copy link

Same problem here.
Given that using template variables is not supported, this bug kills the only case where I could use Grafana for alerts.

@cryptobioz cryptobioz added the bug label Jan 21, 2019
@cryptobioz
Copy link
Member

@Santec Which version of Grafana and of the datasource are you using? Could you share the request created by the datasource and sent to the alertmanager (value of url in the Grafana's query inspector)?

@mfuhrmann
Copy link
Author

Meanwhile it' Grafana 5.3.4 and 0.0.7 in my case. And it still does not filter.
URL in my case:
url:"https://server.domain.com/alert-manager//api/v1/alerts?silenced=false&inhibited=false&filter=context%3D%22IT%22%0A"

@mfuhrmann
Copy link
Author

Since I'm using 6.2.x and the current version of this plugin (which is still the same), it works for me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

5 participants