Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rename prometheus.remote_write dashboard & add scrape metrics #6222

Merged
merged 2 commits into from
Jan 24, 2024

Conversation

thampiotr
Copy link
Contributor

@thampiotr thampiotr commented Jan 23, 2024

PR Description

This adds visibility of scrape performance to our main Prometheus dashboard (currently called prometheus.remote_write)

image

We've agreed to have one dashboard per component namespace, with metrics of each component in separate collapsible rows on the dashboard. So also doing the following:

  • Renaming prometheus.remote_write dashboard to "Prometheus Components"
  • Adding rows for each component
  • Putting prometheus.scrape on top as discussed, to reflect better the pipeline order.

Which issue(s) this PR fixes

(internal issue)

Notes to the Reviewer

This is a follow-up from an incident where scrape performance was badly affected, but it was hard to notice this using our dashboards.

During the incident, the query we're adding here would clearly highlight the issue:
image

PR Checklist

  • CHANGELOG.md updated

@thampiotr thampiotr marked this pull request as ready for review January 23, 2024 14:53
@thampiotr thampiotr force-pushed the thampiotr/add-scrape-performance-to-dash branch from 3de9b8a to cfe229b Compare January 23, 2024 15:21
@thampiotr thampiotr changed the title Add visibility of scrape performance to dashboards Rename prometheus.remote_write dashboard & add scrape metrics Jan 24, 2024
@thampiotr thampiotr force-pushed the thampiotr/add-scrape-performance-to-dash branch from cf72d23 to ab46a7b Compare January 24, 2024 13:50
@thampiotr thampiotr force-pushed the thampiotr/add-scrape-performance-to-dash branch from ab46a7b to 2868750 Compare January 24, 2024 13:51
@thampiotr thampiotr merged commit 78a2632 into main Jan 24, 2024
10 checks passed
@thampiotr thampiotr deleted the thampiotr/add-scrape-performance-to-dash branch January 24, 2024 17:51
BarunKGP pushed a commit to BarunKGP/grafana-agent that referenced this pull request Feb 20, 2024
…a#6222)

* Add visibility of scrape performance to dashboards

* Address feedback
@github-actions github-actions bot added the frozen-due-to-age Locked due to a period of inactivity. Please open new issues or PRs if more discussion is needed. label Feb 24, 2024
@github-actions github-actions bot locked as resolved and limited conversation to collaborators Feb 24, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
frozen-due-to-age Locked due to a period of inactivity. Please open new issues or PRs if more discussion is needed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants