Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ISSUE-169] Support metric reporter and Support promethues push gateway #415

Merged
merged 10 commits into from
Dec 21, 2022

Conversation

xianjingfeng
Copy link
Member

What changes were proposed in this pull request?

Support metric reporter and Support promethues push gateway

Why are the changes needed?

Users can implement custom export plugin to export metrics to their monitoring system. #169

Does this PR introduce any user-facing change?

No

How was this patch tested?

UT

# Conflicts:
#	coordinator/src/main/java/org/apache/uniffle/coordinator/CoordinatorServer.java
@xianjingfeng xianjingfeng changed the title [ISSUE-169] [WIP][ISSUE-169] Support metric reporter and Support promethues push gateway Dec 13, 2022
pom.xml Outdated Show resolved Hide resolved
@codecov-commenter
Copy link

codecov-commenter commented Dec 13, 2022

Codecov Report

Merging #415 (2fce4f4) into master (66c752f) will increase coverage by 0.08%.
The diff coverage is 64.77%.

@@             Coverage Diff              @@
##             master     #415      +/-   ##
============================================
+ Coverage     58.54%   58.62%   +0.08%     
- Complexity     1611     1632      +21     
============================================
  Files           195      198       +3     
  Lines         11035    11130      +95     
  Branches        966      986      +20     
============================================
+ Hits           6460     6525      +65     
- Misses         4195     4218      +23     
- Partials        380      387       +7     
Impacted Files Coverage Δ
.../java/org/apache/uniffle/server/ShuffleServer.java 64.38% <12.50%> (-3.01%) ⬇️
.../apache/uniffle/coordinator/CoordinatorServer.java 61.46% <35.71%> (-3.80%) ⬇️
.../uniffle/common/metrics/MetricReporterFactory.java 57.14% <57.14%> (ø)
...rometheus/PrometheusPushGatewayMetricReporter.java 74.46% <74.46%> (ø)
.../org/apache/uniffle/common/config/RssBaseConf.java 93.82% <100.00%> (+0.19%) ⬆️
...uniffle/common/metrics/AbstractMetricReporter.java 100.00% <100.00%> (ø)
.../java/org/apache/uniffle/common/util/RssUtils.java 58.45% <0.00%> (-2.14%) ⬇️
...rg/apache/uniffle/client/util/DefaultIdHelper.java 100.00% <0.00%> (ø)
...org/apache/uniffle/storage/common/HdfsStorage.java 0.00% <0.00%> (ø)
...pache/hadoop/mapreduce/task/reduce/RssShuffle.java 0.00% <0.00%> (ø)
... and 13 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@jerqi jerqi linked an issue Dec 13, 2022 that may be closed by this pull request
pom.xml Outdated Show resolved Hide resolved
pom.xml Outdated Show resolved Hide resolved
@jerqi
Copy link
Contributor

jerqi commented Dec 15, 2022

Could we add some docs about this feature?

@xianjingfeng
Copy link
Member Author

Could we add some docs about this feature?

Yes

@jerqi
Copy link
Contributor

jerqi commented Dec 21, 2022

Is this pr ready for review?

@xianjingfeng xianjingfeng changed the title [WIP][ISSUE-169] Support metric reporter and Support promethues push gateway [ISSUE-169] Support metric reporter and Support promethues push gateway Dec 21, 2022
@xianjingfeng
Copy link
Member Author

Is this pr ready for review?

Yes

Copy link
Contributor

@jerqi jerqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, @advancedxy do you have another suggestion?

Copy link
Contributor

@advancedxy advancedxy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jerqi jerqi merged commit 9635d7a into apache:master Dec 21, 2022
@jerqi
Copy link
Contributor

jerqi commented Dec 21, 2022

thanks @advancedxy @xianjingfeng

@xianjingfeng xianjingfeng deleted the issue_169 branch March 1, 2023 12:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature Request] Support push metrics to Prometheus Pushgateway
4 participants