Consumer lag live updates

[Gleb-Shipilov]

Issue submitter TODO list

• I've searched for an already existing issues here
• I'm running a supported version of the application which is listed here and the feature is not present there

Is your proposal related to a problem?

No response

Describe the feature you're interested in

User story

I as a Kafbat UI user want to see live updates of consumer lag on "Consumers" page and inside each consumer for all topics of a consumer group, so that I can see how the lag is changing in near real-time without updating the page.

Acceptance criteria

1. Live Lag Updates on the "Consumers" Page

When a user is on the "Consumers" page.

Given the consumer group list is displayed.

Then the "Lag" column for each consumer group should automatically update at a regular, configurable interval without the user needing to refresh the page. Refreshing interval default value is 5 seconds.

2. Live Lag Updates Inside a Specific Consumer Group

When a user clicks on a specific consumer group to view its details.

Given the page displays the list of topics consumed by that group, along with their respective lags.

Then the lag for each individual topic/partition should automatically update in near real-time, reflecting changes as messages are consumed.

3. Visual Indicators and Performance

When the consumer lag for a topic or consumer group is updating.

Given the data is fetched and displayed.

Then the UI should update smoothly, with no visual flickering or performance degradation, even when a large number of topics or consumer groups are being monitored. The update mechanism should be efficient to minimize overhead on the Kafka cluster and the UI itself. The displayed lag values should reflect the difference between the latest offset and the consumer's current offset.

4. User Configuration

When a user is viewing live lag data.

Given the application has a default update interval.

Then the user should have the option to adjust the refresh rate to a slower or faster interval, or to pause the live updates entirely, providing flexibility for different use cases and system loads.

Describe alternatives you've considered

No response

Version you're running

6474fb6

Additional context

No response