Skip to content

HDDS-6362. Add aggregate metrics to ContainerBalancerMetrics#3239

Merged
lokeshj1703 merged 3 commits intoapache:masterfrom
siddhantsangwan:HDDS-6362
Apr 1, 2022
Merged

HDDS-6362. Add aggregate metrics to ContainerBalancerMetrics#3239
lokeshj1703 merged 3 commits intoapache:masterfrom
siddhantsangwan:HDDS-6362

Conversation

@siddhantsangwan
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Add aggregate metrics such as total number of container moves and total size moved across all the iterations of Container Balancer. Currently, only metrics specific to an iteration are present.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-6362

How was this patch tested?

Existing UTs. An integration test or manual testing will be more comprehensive.

@siddhantsangwan
Copy link
Copy Markdown
Contributor Author

@lokeshj1703 @JacksonYao287 @symious Can you please review?

Copy link
Copy Markdown
Contributor

@lokeshj1703 lokeshj1703 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@siddhantsangwan Thanks for working on this! The changes look good to me. Few comments inline.


@Metric(about = "Total data size in GB moved across all iterations of " +
"Container Balancer.")
private MutableCounterLong totalSizeMovedGB;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rename to dataSizeMovedGB


@Metric(about = "Total number of container moves across all iterations of " +
"Container Balancer.")
private MutableCounterLong totalNumContainerMoves;
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rename to numContainerMoves since we already have inLatestIteration suffix.

@symious
Copy link
Copy Markdown
Contributor

symious commented Mar 28, 2022

@siddhantsangwan Thanks for the patch.

Can we add a metrics to record the failed moves of containers? Sometimes it might be helpful to track some issues.

@siddhantsangwan
Copy link
Copy Markdown
Contributor Author

@lokeshj1703 @symious Thanks for reviewing. I'm planning to add a metric for failed moves in this jira: https://issues.apache.org/jira/browse/HDDS-6492

# Conflicts:
#	hadoop-hdds/server-scm/src/main/java/org/apache/hadoop/hdds/scm/container/balancer/ContainerBalancer.java
Copy link
Copy Markdown
Contributor

@lokeshj1703 lokeshj1703 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@siddhantsangwan Thanks for updating the PR! The changes look good to me. +1.

@lokeshj1703 lokeshj1703 merged commit adecbd1 into apache:master Apr 1, 2022
@siddhantsangwan siddhantsangwan deleted the HDDS-6362 branch April 1, 2022 07:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants