Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to add Partition in local.zeek configuration #55

Open
cybersecurity99 opened this issue Jul 7, 2022 · 2 comments
Open

How to add Partition in local.zeek configuration #55

cybersecurity99 opened this issue Jul 7, 2022 · 2 comments

Comments

@cybersecurity99
Copy link

Summary of the issue

I want to add Partition in local.zeek file that contain configuration for kafka.

Expected behavior

To create a x number of partition in all files

Steps to reproduce

...

Where applicable, consider providing a patch that uses the end to end testing environment.

Logs, errors, etc.

I am trying ["partition"]=10 in Kafka::Config
But it is not working

Your environment

  • Version of Zeek
  • Version or commit hash of the zeek-kafka package
  • Operating System and version
@ottobackwards
Copy link
Collaborator

the plugin does not do per topic configuration, and I think the librdkafka does partition strategy configuration in the topic configuration not the global. All the settings in the kafka configuration are global.

To support this we would have to support new configuration local -> topic creation.

At least that is my read. @JonZeolla ?

@ottobackwards
Copy link
Collaborator

@cybersecurity99 if you look at librdkaka and see how you would want to configuration based on what it supports, can you give us an example?
https://docs.confluent.io/5.5.0/clients/librdkafka/md_CONFIGURATION.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants