Skip to content

Stale watermark after partition revoked fix#36

Merged
HubertTatar merged 3 commits intoadform:masterfrom
MFujarewicz:master
Aug 3, 2023
Merged

Stale watermark after partition revoked fix#36
HubertTatar merged 3 commits intoadform:masterfrom
MFujarewicz:master

Conversation

@MFujarewicz
Copy link
Copy Markdown

@MFujarewicz MFujarewicz commented Aug 1, 2023

We noticed bug where some loaders appeared to have linearly growing watermark.delay.ms. Investigation revealed that after consumer rebalance loaders still emit watermark.delay.ms metric for parition that they not longer consume. This PR adds logic to remove watermark gauge from metric registry after partion revoked event.

I belive .close() call on removed gauges was meant to remove metric, but this function only invokes empty default implementation form https://github.com/micrometer-metrics/micrometer/blob/1.10.x/micrometer-core/src/main/java/io/micrometer/core/instrument/Meter.java#L483. This method is not overriden in Gauge.

m.fujarewicz added 2 commits July 31, 2023 16:30
@HubertTatar HubertTatar merged commit 4614fd7 into adform:master Aug 3, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants