As streaming grows increasingly common, data processing and real-time analytics become more of a necessity — but Kafka has no built-in functionality allowing users to view key performance metrics. deKaf bridges that gap: it's a web-based metrics visualization tool that monitors Kafka activity, focusing on performance and spread relevant metrics of the producers, topics, and consumers.
deKaf prides itself on simplicity. On the same server you have a kafka instance running, follow these steps.
-
In the browser navigate to deKaf.app.
-
Follow the prompts to create an account and log in. You will be redirected to the Broker Overview page.
-
Enter your port number the kafka instance is running on and click on Add Port.
-
Enter the topic you wish you to monitor, the number of partitions on the specified topic and the replication factor for your data. Click on Add Topic To Monitor
You may enter as many topics as you wish to monitor
-
If you do not have any data being sent to your producer but you still want to test your kakfa cluster, simply click the generate random data check box. We will generate mock data and send it to your produce for you.
-
Once all the data has been enter, click View Metrics
After entering the information you will be taken to our metrics overview page where live data will be rendered. Here we have seperated the metrics into four categories.
Topic Data: Once topic tab is clicked you will see the following data:
- Topic Names
- Partitions in each topic
- Quantity of messages within each partition
Messages: Once the messages tab is clicked you will see the following data:
- Latest message sent to the specified topic
- Partition the message was sent to
- Total messages within that consumer
Consumer: Once the consumer tab is clicked you will see the following data:
- Total messages recieved by that consumer
- Message quantity over time
- Message sizes
Producer: Once the producer tab is clicked you will see the following data:
- Total messages sent by the producer
- Message quantity over time
- Message sizes
% Focal Techs incorporated %
React Hooks/Router, SCSS/CSS, D3, Typescript, Kafka w/ KafkaJS, Docker, AWS
- Testing: Enzyme, Supertest