How to configure Bucket size , message size and message per second rate

[cybersecurity99]

Summary of the issue

...
I want to measure the rate at which Kafka will be processing for 1G or 10G /s rate
So How to configure Bucket size , message size and message per second rate to check the sizing of kafka
in this plugin anyway to modify or check that

Your environment

• Version of Zeek 4.0.5
• Version or commit hash of the zeek-kafka package current
• Operating System and version 20.04 LTS

[cybersecurity99]

Hi @JonZeolla any view on this

[JonZeolla]

@cybersecurity99 I'm not sure we have a great answer for this. You can configure anything that the underlying library accepts via kafka_conf (documented in https://github.com/SeisoLLC/zeek-kafka#kafka_conf) so there may be something useful downstream from us.

Another thing you could do if you wanted to gather information about what's currently happening is configure certain debug logs. These are also passed through to the underlying library, and are documented in https://github.com/SeisoLLC/zeek-kafka#debug

[JonZeolla]

@cybersecurity99 did you have any additional questions on this one?