Skip to content

[metrics] Add totalFileCount and minAvgFileSize metrics to detect small file problem - #9449

Merged
JingsongLi merged 1 commit into
apache:masterfrom
junmuz:feature/small-files-metrics
Aug 29, 2026
Merged

[metrics] Add totalFileCount and minAvgFileSize metrics to detect small file problem#9449
JingsongLi merged 1 commit into
apache:masterfrom
junmuz:feature/small-files-metrics

Conversation

@junmuz

@junmuz junmuz commented Aug 28, 2026

Copy link
Copy Markdown
Contributor

Purpose

  • Adds totalFileCount metric to track the total number of data files across all levels
  • Adds minAvgFileSize metric to surface when average file size drops below a healthy threshold
  • These metrics help detect the small file problem early, enabling proactive compaction tuning

Tests

  • Unit test added in CompactionMetricsTest
  • Documentation updated in docs/maintenance/metrics.md

@JingsongLi JingsongLi closed this Aug 28, 2026
@JingsongLi JingsongLi reopened this Aug 28, 2026
@JingsongLi

Copy link
Copy Markdown
Contributor

+1

@JingsongLi
JingsongLi merged commit 69406b5 into apache:master Aug 29, 2026
25 of 28 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants