Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Multi instance apps should share consumer group #14

Closed
krojew opened this issue Dec 19, 2017 · 2 comments
Closed

Multi instance apps should share consumer group #14

krojew opened this issue Dec 19, 2017 · 2 comments

Comments

@krojew
Copy link

krojew commented Dec 19, 2017

At this moment app_info assumes multi instance apps are in different consumer groups, which makes them not scalable.

@skarlsson
Copy link
Member

skarlsson commented Dec 19, 2017

Maybe its bad documentation, but the third argument is not meant for instance since I really mean that the program should take the handled partitions as arguments (or handle all - which does not scale). I've had the use case that a single app handles different "tenants" not partitions - in that case the third argument makes sense. No automatic scaling a'la kafka streams is implemented. Partly because I wanted to avoid the penalty of reassigning state stores when you add a new instance.

@krojew
Copy link
Author

krojew commented Dec 20, 2017

Ah, so multi instance should rather be multi tenant. I suggest changing/adding some comments about it. Automatic scaling would be a good idea, tho.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants