Skip to content

[SUPPORT] Can't get numDeletes in HoodieMetrics #6148

@CaesarWangX

Description

@CaesarWangX

Hi Team, I have a problem in the process of using HoodieMetrics

How I use it:
I use the customized MetricsRepoter which extends AbstractUserDefinedMetricsReporter, and get sortedMap<string, gauge> through MetricRegistry, but I can't get the data related to numDeletes in the result.

What have I done:
I go through the source code of HoodieMetrics and HoodieCommitMetadata. I found that the method getTotalRecordsDeleted has been defined in HoodieCommitMetadata in Hudi, but there is no call to getTotalRecordsDeleted in HoodieMetrics. In this case, using Hudi's metrics cannot obtain the amount of data deleted.

Question:
Is this a bug?
If so, which version is expected to be repaired?
If not, is there any plan to add it to metrics in a later version? Or is there any other way to get numDeletes from metrics?

Thanks in advance

Metadata

Metadata

Assignees

Labels

area:metricsMetrics and monitoringpriority:mediumModerate impact; usability gapstype:featureNew features and enhancements

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions