Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix metric reporting #638

Merged
merged 3 commits into from
Jun 29, 2021
Merged

fix metric reporting #638

merged 3 commits into from
Jun 29, 2021

Conversation

fr0stbyte
Copy link
Contributor

ran into the same issue as #637 with partitions with 0 offsets - the patch below worked for me

@fr0stbyte fr0stbyte requested a review from bai as a code owner June 11, 2020 14:46
@bai
Copy link
Collaborator

bai commented Jun 19, 2020

/cc @d1egoaz @andrewjamesbrown

@arthurvanduynhoven
Copy link

@bai Any update on ETA for this MR to be accepted/merged?

Copy link
Contributor

@d1egoaz d1egoaz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@fr0stbyte it looks like the why of these can only be found in #637 (comment), I'd rather have this information as part of the commit messages of this PR.

there is also some new assertion to be made on the tests to check that this PR is doing what is supposed to be doing

consumerPartitionLagGauge.With(labels).Set(float64(partition.CurrentLag))

if partition.Complete >= 1.0 {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could Complete be greather than 1, or is this only a percentage and we could use here == 1.0?

@@ -151,6 +151,5 @@ func TestHttpServer_handlePrometheusMetrics(t *testing.T) {
assert.Contains(t, promExp, `burrow_kafka_topic_partition_offset{cluster="testcluster",partition="1",topic="testtopic"} 5566`)
assert.Contains(t, promExp, `burrow_kafka_topic_partition_offset{cluster="testcluster",partition="0",topic="testtopic1"} 54`)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

wasn't the idea to get a lag report for the topic incomplete? I think we are missing and assertion above as consumerPartitionLagGauge.With(labels).Set(float64(partition.CurrentLag)) will be called now even if Complete is below 1

@mwain
Copy link
Contributor

mwain commented Oct 26, 2020

I came across the same issue earlier this week, sorry i wasn't keeping an eye on the repo
Fix im using is linkedin:master...mwain:fix-prom-incomplete

Which is very similar to this one 👍

@omaskery
Copy link

omaskery commented Nov 5, 2020

Hullo, is there anything I can do to help move this PR forward? :)

@fr0stbyte
Copy link
Contributor Author

Sorry folks, I have been busy at work, will try to take another pass at this in the following days.

@Fran-ELS-AMS
Copy link

I have the same issue and would love to see this PR merged.

Has there been any progress?

@fr0stbyte
Copy link
Contributor Author

@d1egoaz let me know if the tests added are sufficient or you have other comments

@curtiseppel
Copy link

Going on a full year now - how can I help get this merged?

Tagging @bai as a code owner.

@bai bai merged commit 4d1505c into linkedin:master Jun 29, 2021
@curtiseppel
Copy link

Thanks all! 🎉 🚢

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants