Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grafana Dashboard #1097

Closed
giz33 opened this issue Mar 8, 2024 · 5 comments
Closed

Grafana Dashboard #1097

giz33 opened this issue Mar 8, 2024 · 5 comments

Comments

@giz33
Copy link

giz33 commented Mar 8, 2024

Hello!
I'm trying to understand how to use the https://github.com/pyrra-dev/pyrra/tree/main/examples/grafana.
And it says that I need to use --generic-rules, but where??
I need to use this flag when I am deploying Pyrra? Or when I am deployng the SLO's manifests inside examples/kubernetes/manifests/slos? Or I need to edit one of these manifests to put the --generic-rules inside ?

Thanks in advance for any help.

@metalmatze
Copy link
Member

You need to run two Pyrra components.
One with the api command and one with the filesystem or kubernetes command. The filesystem or kubernetes components need to be run with this --generic-rules flag.

Hopefully you could figure it out in the mean time.
I'll make sure to update the documentation there to make it more obvious.

@giz33
Copy link
Author

giz33 commented Apr 1, 2024

Hello!Tks for the answer!
I am trying to use the helm chart to deploy it and use with Grafana: https://artifacthub.io/packages/helm/rlex/pyrra
So far so good I am able to install it and run a pyrra-kubernetes changing the parameter generic-rules to true inside values.yaml.

image

But it keeps showing nothing on my Grafana dashboards.

image

I suspect about two things:
1 - I need to pass some args to pyrra-kubernetes using extraKubernetesArgs to point to my correct PrometheusURL, as you can see on the logs its using localhost:9090, but I have prometheus running on prometheus-operated.monitoring.svc.cluster.local:9090.
But I don't know which args I can pass on this parameter extraKubernetesArgs on values.yaml to change this.

2 - As you can see, it starts a metrics server on port 8080, but I don't see any exposed service to make my prometheus scrap this.And again, maybe there is some parameter that I can pass using extraKubernetesArgs and I don't know which parameters I can use(I didn't fin any documentation about parameter that I can use on it).
image

Tks in advance for any help.

@giz33
Copy link
Author

giz33 commented Apr 2, 2024

I was able to make it works!
After identify that the prometheus operator uses a label to connect to all the objects that makes part of the solution I see that the components created by Parry doesn't have the correct label on it.
After change the label on rules and the SLO's objects to match the label used by my prometheus created by kube-prom operator, it works!

Thanks!

@giz33 giz33 closed this as completed Apr 2, 2024
@stoopman
Copy link

I was able to make it works! After identify that the prometheus operator uses a label to connect to all the objects that makes part of the solution I see that the components created by Parry doesn't have the correct label on it. After change the label on rules and the SLO's objects to match the label used by my prometheus created by kube-prom operator, it works!

Thanks!

@giz33 can you please elaborate on which label specific this is? I have kube-prometheus-stack helm chart installed which includes the prometheus operator but no generic rules metrics (such as pyrra_objective) are being created in prometheus

@giz33
Copy link
Author

giz33 commented Apr 23, 2024

@stoopman I put the label "release: prometheus"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants