Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Proper aggregation of istio metrics using prometheus federation #9700

Merged

Conversation

rakesh-garimella
Copy link
Contributor

@rakesh-garimella rakesh-garimella commented Oct 14, 2020

Description

Changes proposed in this pull request:

  • Introduce new prometheus instance for scraping istio metrics
  • Configure main prometheus to scrape aggregated metrics from federation endpoint
  • Unset scrape interval for all servicemonitors in order to have one common default applied
  • Drop as much labels as possible from istio metrics

Related issue(s)

Fixes: #9701

hisarbalik
hisarbalik previously approved these changes Oct 14, 2020
@hisarbalik
Copy link
Contributor

/retest

@hisarbalik hisarbalik added the area/monitoring Issues or PRs related to the monitoring module (deprecated) label Oct 14, 2020
@a-thaler a-thaler changed the title Proper aggregation of istio metrics, increasing memory Proper aggregation of istio metrics using prometheus federation Oct 18, 2020
a-thaler
a-thaler previously approved these changes Oct 18, 2020
a-thaler
a-thaler previously approved these changes Oct 19, 2020
piotrmsc
piotrmsc previously approved these changes Oct 19, 2020
a-thaler
a-thaler previously approved these changes Oct 19, 2020
docs/monitoring/05-04-production-profile.md Outdated Show resolved Hide resolved
docs/monitoring/05-03-prometheus.md Outdated Show resolved Hide resolved
docs/monitoring/05-03-prometheus.md Outdated Show resolved Hide resolved
docs/monitoring/05-04-production-profile.md Outdated Show resolved Hide resolved
Co-authored-by: Klaudia Grzondziel <35192450+klaudiagrz@users.noreply.github.com>
@a-thaler a-thaler dismissed stale reviews from piotrmsc and themself via b55af3d October 19, 2020 08:51
@a-thaler
Copy link
Contributor

/retest

@a-thaler a-thaler merged commit 01b46b3 into kyma-project:master Oct 19, 2020
dbadura pushed a commit to dbadura/kyma that referenced this pull request Oct 19, 2020
…-project#9700)

* switch to federation for istio metrics by adding a second prometheus
dbadura pushed a commit that referenced this pull request Oct 29, 2020
* switch to federation for istio metrics by adding a second prometheus
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/monitoring Issues or PRs related to the monitoring module (deprecated)
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Istio metrics are not properly aggregated
6 participants