Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
For partitions that receive data very slowly, it is possible for Burrow to falsely alert for stopped partitions. This case is described in #303 (the second case). This is the starting state:
Then the following things happen:
To get around this, we need to wait a little bit to give the consumer a chance to see the new message and commit an updated offset. We can do this by storing the recent browser offsets that Burrow has gotten for the partition. If one of those recent offsets would have had the consumer at zero lag, we don't consider the partition to be stopped. If the
interval
config is 10, and the clusteroffset-refresh
is 30 seconds, this would delay the partition being marked as stopped by 5 minutes.This does not expose the broker offset history to the user, or use it in any other way except when the partition might be considered stopped.