Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

MetricsTest should clear metrics in advance to make test result stable fixes #94 #95

Merged
merged 1 commit into from
Mar 12, 2021

Conversation

ocadaruma
Copy link
Member

Summary

@ocadaruma ocadaruma requested a review from kawamuray March 5, 2021 07:42
Copy link
Member

@kawamuray kawamuray left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for catching this 👍

Besides the necessity of clearing metrics at the beginning, I think CompationProcessor should make sure to cleanup its metrics on its close()?

@ocadaruma
Copy link
Member Author

ocadaruma commented Mar 12, 2021

@kawamuray Good point.

But I found that closing CompationProcessor metrics properly requires extra work, that is:

  • Since CompactionProcessor's metrics are registered per every task to tag with subscriptionId, we can't use AbstractMetrics
  • Possible solution is to make CompactionProcessor's constructor receives subscriptionId and pass it through ProcessorsBuilder
  • But it causes breaking changes, and until then, master's test keeps failing.
  • By the way, even CompactionProcessor's metrics are not cleaned up, it doesn't cause actual problem because it's tagged by subscriptionId (unlike other metrics (partition, thread,)), so the tag will still be valid even after rebalance

So, let's merge this PR as-is, and solve CompactionProcessor's metrics clean-up problem in another PR?

@kawamuray kawamuray merged commit 5c70748 into line:master Mar 12, 2021
@ocadaruma ocadaruma deleted the fix-flaky-metrics-test branch March 12, 2021 07:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants