Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Followup/feat/cloud storage compaction metric #17723

Merged

Conversation

andijcr
Copy link
Contributor

@andijcr andijcr commented Apr 10, 2024

Backports Required

  • none - not a bug fix
  • none - this is a backport
  • none - issue does not exist in previous branches
  • none - papercut/not impactful enough to backport
  • v23.3.x
  • v23.2.x

Release Notes

return a struct with the byte-size of the replaced segments and the
byte-size for the new segment.

useful to monitor change in cloud storage size due to compacted
reuploads
keep track in a counter of the result of the _manifest->add() operation,
if it's a segment reupload operation.

the counter is not persisted, so the value is reset every time the
manifest is recreated
vectorized_ntp_archiver_compacted_replaced_bytes
Perform update of the metric after the manifest is uploaded.

The intention is to not show in the metrics the value until the manifest
is visible in cloud_storage.
monitor vectorized_ntp_archiver_compaction_replaced_bytes, check that it
strictly increases if the leader hasn't changed.
Copy link

mergify bot commented Apr 10, 2024

⚠️ The sha of the head commit of this PR conflicts with #17627. Mergify cannot evaluate rules on this PR. ⚠️

@piyushredpanda piyushredpanda closed this pull request by merging all changes into redpanda-data:dev in c4e9ab2 Apr 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants