Skip to content

Conversation

@zcoo
Copy link
Contributor

@zcoo zcoo commented Aug 13, 2025

Purpose

Linked issue: close #1525
Linked issue: close #1526

Brief change log

Tests

API and Format

Documentation

@zcoo zcoo force-pushed the 20250812_metric_upgrade branch from 70203d9 to d536b18 Compare August 14, 2025 07:03
Copy link
Contributor

@swuferhong swuferhong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Left some comments.

@zcoo
Copy link
Contributor Author

zcoo commented Aug 19, 2025

Thanks for reviewing @swuferhong . I have adjusted the position and description. PLAT~

@zcoo zcoo force-pushed the 20250812_metric_upgrade branch from ccc3990 to aeffd00 Compare August 19, 2025 07:08
@wuchong
Copy link
Member

wuchong commented Aug 26, 2025

@zcoo could you rebase and resolve the conflicts?

@zcoo zcoo force-pushed the 20250812_metric_upgrade branch from a8afc1c to 3d0604e Compare August 27, 2025 07:48
@zcoo
Copy link
Contributor Author

zcoo commented Aug 27, 2025

@wuchong Sure. Now conflicts are resolved.

@polyzos polyzos force-pushed the main branch 3 times, most recently from d88c76c to 434a4f4 Compare August 31, 2025 15:13
public static final String LOG_NUM_SEGMENTS = "numSegments";
public static final String LOG_END_OFFSET = "endOffset";
public static final String LOG_SIZE = "size";
public static final String LOG_FLUSH_RATE = "flushPerSecond";
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Considering this will be moved from bucket-level to server-level, it's better to add "log" prefix to distinguish with the metric of kv. E.g., logFlushPerSecond and logFlushLatencyMs

Comment on lines 114 to 116
public static final String KV_PRE_WRITE_BUFFER_FLUSH_RATE = "preWriteBufferFlushPerSecond";
public static final String KV_PRE_WRITE_BUFFER_FLUSH_LATENCY_MS =
"preWriteBufferFlushLatencyMs";
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's better to name them kvFlushPerSecond and kvFlushLatencyMs to keep align with the log metrics.


// for kv tablet
public static final String KV_LATEST_SNAPSHOT_SIZE = "latestSnapshotSize";
public static final String KV_PRE_WRITE_BUFFER_TRUNCATE_AS_DUPLICATED_RATE =
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We should remove the void registerMetrics(BucketMetricGroup bucketMetricGroup) of KvTablet, because we don't need to report bucket-level pre-write-buffer metrics.

@wuchong
Copy link
Member

wuchong commented Sep 11, 2025

@zcoo @swuferhong I appended a commit to address above comments, please take a look, especially the metric renaming.

@wuchong wuchong force-pushed the 20250812_metric_upgrade branch from 3d0604e to 39fa282 Compare September 11, 2025 07:53
Copy link
Contributor

@swuferhong swuferhong left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM +1. I will rebase #1548 after this pr merged.

@wuchong wuchong merged commit 03313a9 into apache:main Sep 12, 2025
6 checks passed
polyzos pushed a commit to polyzos/fluss that referenced this pull request Sep 21, 2025
polyzos pushed a commit to polyzos/fluss that referenced this pull request Sep 21, 2025
leosanqing pushed a commit to leosanqing/fluss that referenced this pull request Sep 29, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[metric] Change some bucket level metrics to table level [metric] aggregate some table partition level metrics to table level

3 participants