Skip to content

[HUDI-4719] Add metrics config for flink#6497

Closed
wuwenchi wants to merge 1 commit intoapache:masterfrom
wuwenchi:metrics_for_flink
Closed

[HUDI-4719] Add metrics config for flink#6497
wuwenchi wants to merge 1 commit intoapache:masterfrom
wuwenchi:metrics_for_flink

Conversation

@wuwenchi
Copy link
Contributor

Change Logs

Describe context and summary for this change. Highlight if any code was copied.

Impact

Describe any public API or user-facing feature change or any performance impact.

Risk level: none | low | medium | high

Choose one. If medium or high, explain what verification was done to mitigate the risks.

Contributor's checklist

  • Read through contributor's guide
  • Change Logs and Impact were stated clearly
  • Adequate tests were added if applicable
  • CI passed

@wuwenchi
Copy link
Contributor Author

@danny0405 Could you help review it? Thanks!

@hudi-bot
Copy link
Collaborator

CI report:

Bot commands @hudi-bot supports the following commands:
  • @hudi-bot run azure re-run the last Azure build

@yihua yihua added engine:flink Flink integration priority:high Significant impact; potential bugs area:metrics Metrics and monitoring labels Sep 6, 2022

private void updateCommitTimingMetrics(long commitEpochTimeInMs, long durationInMs, HoodieCommitMetadata metadata,
String actionType) {
String actionType) {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Revert this change to keep the indent of the code style.

// Metrics Options
// ------------------------------------------------------------------------

public static final ConfigOption<Boolean> METRICS_ON = ConfigOptions
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
public static final ConfigOption<Boolean> METRICS_ON = ConfigOptions
public static final ConfigOption<Boolean> TURN_METRICS_ON = ConfigOptions

.withDescription("Max delta commits for metadata table to trigger compaction, default 10");

// ------------------------------------------------------------------------
// Metrics Options
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could metric options introduce METRICS_REPORTER_CLASS_NAME.key()?

@SteNicholas
Copy link
Member

@wuwenchi, thanks for metric configs contribution. Could you please add certain tests to verify? cc @danny0405

@github-actions github-actions bot added the size:S PR with lines of changes in (10, 100] label Feb 26, 2024
Copy link
Contributor

@yihua yihua left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@danny0405 is this already supported?

@cshuo cshuo mentioned this pull request Dec 3, 2025
@danny0405
Copy link
Contributor

The metrics should work now since fix: #9637, close it as invalid.

@danny0405 danny0405 closed this Dec 3, 2025
@github-project-automation github-project-automation bot moved this from 🔖 Ready for review to ✅ Done in Hudi PR Support Dec 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:metrics Metrics and monitoring engine:flink Flink integration priority:high Significant impact; potential bugs size:S PR with lines of changes in (10, 100]

Projects

Status: 🚧 Needs Repro
Status: ✅ Done

Development

Successfully merging this pull request may close these issues.

5 participants