-
Notifications
You must be signed in to change notification settings - Fork 3.7k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Allow user to set group.id for Kafka ingestion task #11147
Allow user to set group.id for Kafka ingestion task #11147
Conversation
Maybe the section More on consumerProperties in kafka-ingestion.md needs to be updated to reflect the change in this PR ? |
updated |
@@ -40,6 +40,8 @@ This service is provided in the `druid-kafka-indexing-service` core Apache Druid | |||
> In addition, users could set `isolation.level` `read_uncommitted` in `consumerProperties`, if don't need Druid to consume transactional topics or need Druid to consume older versions of Kafka. | |||
> Make sure offsets are sequential, since there is no offset gap check in Druid anymore. | |||
|
|||
> If your Kafka cluster enables ACLs, you can set `group.id` in `consumerProperties` to override the defualt auto generated group id. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
After updating the doc, you may need to add the ACLs
to the .spelling
file, and then please use default
instead of defualt
.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
👍
Co-authored-by: frank chen <frankchen@apache.org>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM 👍
Fixes #8715.
Key changed/added classes in this PR
KafkaConsumerConfigs
KafkaRecordSupplier
KafkaIndexTask
This PR has: