Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grafana 8 Unified Alerts Error Unsupported Path #1493

Closed
arnoldyahad opened this issue Jul 26, 2021 · 5 comments
Closed

Grafana 8 Unified Alerts Error Unsupported Path #1493

arnoldyahad opened this issue Jul 26, 2021 · 5 comments
Labels
bug Something isn't working

Comments

@arnoldyahad
Copy link
Contributor

Hey guys,
We are using VMDB 1.62.0, and recently we updated our grafana to 8.0.6
we opted-in the new unified alerts system: link here and here

Now we see that in the alerts menu in grafana there is this message:
image

To Reproduce
Use VMDB as a prometheus datasource in Grafana(version 8.0.6), enable the new unified alerting system:
here through your grafana configuration(usually /etc/grafana/grafana.ini)

Expected behavior
Fixing the endpoint to be valid for Grafana 8.

Logs
Logs from our kibana show that this query is being performed multiple times in a second:
image
It fills up the warning logs, and its also an unnecesary load on vmselect.

@jinlongwang
Copy link

jinlongwang commented Jul 26, 2021

It seems that there is no rule-related interface implemented in VictoriaMetric
image
just placeholder

@arnoldyahad
Copy link
Contributor Author

arnoldyahad commented Jul 27, 2021

thanks for replying @jinlongwang

when using the endpoint you provided - it works, but its not the endpoint that grafana is querying:

# This is what grafana tries to query: 
curl https://my-vmselect/select/0/prometheus/rules
remoteAddr: "xx.xx.xx.xx:54348", X-Forwarded-For: "xx.xx.xx.xx"; unsupported path requested: "/select/0/prometheus/rules"

# This is what is implemented to work 
 curl https://my-vmselect/select/0/prometheus/api/v1/rules
{"status":"success","data":{"groups":[]}}%

so basically the change needed here is relatively small - just to open another case of prometheus/rules which is a copy of prometheus/api/v1/rules

@Zhouhenry
Copy link

according to the error msg, it can be found it is the return of vm-auth, maybe you need to have a look of auth.config.

@arnoldyahad
Copy link
Contributor Author

Thanks for the reply @Zhouhenry but it doesnt work even locally:

/ # curl localhost:8481/select/0/prometheus/api/v1/rules
{"status":"success","data":{"groups":[]}}/ #
/ #
/ # curl localhost:8481/select/0/prometheus/rules
remoteAddr: "127.0.0.1:55908"; unsupported path requested: "/select/0/prometheus/rules"
/ #

It just needs to be on a different endpoint to support grafana 8 unified alerting.

@valyala valyala added the bug Something isn't working label Jul 29, 2021
valyala added a commit that referenced this issue Jul 29, 2021
valyala added a commit that referenced this issue Jul 29, 2021
@valyala
Copy link
Collaborator

valyala commented Aug 15, 2021

VictoriaMetrics should return dummy response for /rules page starting from v1.64.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants