I use this library to connect to Kafka in a scenario with a large amount of data. How can I know whether the current performance is sufficient?

[kslz]

sorry my English is not good

I use this library. I want to count the number of topics in an hour. But I don't know whether I will block when running the program because of the large amount of data, so I can't count all the times of topic when I stop the task. Is there any way to know whether the current performance is sufficient?

Do I need to start multiple KafkaConsumers with multiple processes？

[kocic11]

If you have a topic with multiple partitions, you can have one consumer per partition per consumer group, which will help with the performance.

Here, you can find more about this.

[kslz]

If you have a topic with multiple partitions, you can have one consumer per partition per consumer group, which will help with the performance.

Here, you can find more about this.

thanks it help me a lot