Skip to content
This repository has been archived by the owner on Jun 10, 2022. It is now read-only.

Batch consume #180

Closed
simPod opened this issue Jan 30, 2018 · 4 comments
Closed

Batch consume #180

simPod opened this issue Jan 30, 2018 · 4 comments

Comments

@simPod
Copy link
Contributor

simPod commented Jan 30, 2018

If I want to consume in batches, how would you approach this?

I found that it's possilbe to set auto.commit.enable = false to consumer and commit manually so theoretically, I could be consuming eg 10K messages into a buffer and after processing them do the commit.

Is there a way to set this option to consumer? Or different approach?

Thanks!

@simPod
Copy link
Contributor Author

simPod commented Jan 31, 2018

So in there groupId mentioned https://github.com/weiboad/kafka-php/blob/master/docs/Configure.md. In official documentation https://kafka.apache.org/documentation.html#consumerconfigs, its name is group.id

I suppose we don't have enable.auto.commit. I tried to figure how, how these work but honestly was not able to find a way to add it here...

@simPod
Copy link
Contributor Author

simPod commented Feb 12, 2018

I worked on something that might make it possilbe in a proper "kafka-way"

@simPod simPod closed this as completed Sep 7, 2018
@parveenbadoni
Copy link

I worked on something that might make it possilbe in a proper "kafka-way"

What change did you make? I also want to change enable.auto.commit to false.

@simPod
Copy link
Contributor Author

simPod commented Mar 2, 2020

Sorry, don't remember, not using this lib anymore.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants