Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

expose managedLedgerCache, managedLedger, loadBalance metrics to prometheus #6705

Merged
merged 4 commits into from
Apr 25, 2020

Conversation

hangc0276
Copy link
Contributor

Motivation

The managed ledger read cache monitor metric is export via /admin/broker-stats/metrics with json format, it is hard to parse, collect and display, what's more the read cache is a very import module for message consuming throughput and latency. So collect and display the read cache metrics is extremely urgent for pulsar in production.

Changes

I parse the json format metric to prometheus message type and export to prometheus monitor port, so those metrics can be displayed in grafana.

Please help check those changes, if it's ok, i will update the metric document.

@@ -20,10 +20,14 @@

import java.io.IOException;
import java.io.OutputStream;
import java.util.Enumeration;
import java.util.*;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@hangc0276 can we avoid wildcard import?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ok,i will update in next commit with metric document.

@sijie sijie added component/stats doc-required Your PR changes impact docs and you will update later. labels Apr 11, 2020
@sijie sijie added this to the 2.6.0 milestone Apr 11, 2020
@codelipenghui
Copy link
Contributor

@hangc0276 You'd better rebase the branch with master since there are some fixes related to integration tests.

@hangc0276
Copy link
Contributor Author

I have updated the document and rebase the master branch, but it still run test case failed. Please help take a look @codelipenghui @sijie

@sijie
Copy link
Member

sijie commented Apr 20, 2020

/pulsarbot run-failure-checks

1 similar comment
@hangc0276
Copy link
Contributor Author

/pulsarbot run-failure-checks

@codelipenghui
Copy link
Contributor

@hangc0276 Could you please rebase the branch?

@hangc0276
Copy link
Contributor Author

@hangc0276 Could you please rebase the branch?

I have rebase the master branch.

@hangc0276
Copy link
Contributor Author

/pulsarbot run-failure-checks

1 similar comment
@hangc0276
Copy link
Contributor Author

/pulsarbot run-failure-checks

@codelipenghui codelipenghui removed the doc-required Your PR changes impact docs and you will update later. label Apr 25, 2020
@codelipenghui codelipenghui merged commit a9ed984 into apache:master Apr 25, 2020
gaoran10 pushed a commit to gaoran10/pulsar that referenced this pull request May 5, 2020
…etheus (apache#6705)

## Motivation
The managed ledger read cache monitor metric is export via /admin/broker-stats/metrics with json format, it is hard to parse, collect and display, what's more the read cache is a very import module for message consuming throughput and latency. So collect and display the read cache metrics is extremely urgent for pulsar in production.

## Changes
I parse the json format metric to prometheus message type and export to prometheus monitor port, so those metrics can be displayed in grafana.

Please help check those changes, if it's ok, i will update the metric document.
gaoran10 pushed a commit to gaoran10/pulsar that referenced this pull request May 5, 2020
…etheus (apache#6705)

## Motivation
The managed ledger read cache monitor metric is export via /admin/broker-stats/metrics with json format, it is hard to parse, collect and display, what's more the read cache is a very import module for message consuming throughput and latency. So collect and display the read cache metrics is extremely urgent for pulsar in production.

## Changes
I parse the json format metric to prometheus message type and export to prometheus monitor port, so those metrics can be displayed in grafana.

Please help check those changes, if it's ok, i will update the metric document.
Huanli-Meng pushed a commit to Huanli-Meng/pulsar that referenced this pull request May 27, 2020
…etheus (apache#6705)

## Motivation
The managed ledger read cache monitor metric is export via /admin/broker-stats/metrics with json format, it is hard to parse, collect and display, what's more the read cache is a very import module for message consuming throughput and latency. So collect and display the read cache metrics is extremely urgent for pulsar in production.

## Changes
I parse the json format metric to prometheus message type and export to prometheus monitor port, so those metrics can be displayed in grafana.

Please help check those changes, if it's ok, i will update the metric document.
huangdx0726 pushed a commit to huangdx0726/pulsar that referenced this pull request Aug 24, 2020
…etheus (apache#6705)

## Motivation
The managed ledger read cache monitor metric is export via /admin/broker-stats/metrics with json format, it is hard to parse, collect and display, what's more the read cache is a very import module for message consuming throughput and latency. So collect and display the read cache metrics is extremely urgent for pulsar in production.

## Changes
I parse the json format metric to prometheus message type and export to prometheus monitor port, so those metrics can be displayed in grafana.

Please help check those changes, if it's ok, i will update the metric document.
cdbartholomew added a commit to kafkaesque-io/pulsar that referenced this pull request Sep 11, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants