Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow users to define Kafka customer group id #3976

Closed
mwysokin opened this issue Jul 4, 2017 · 3 comments

Comments

@mwysokin
Copy link

commented Jul 4, 2017

Expected Behavior

Be able to define a customer group id for Kafka inputs.

Current Behavior

There is a hardcoded customer group id set to graylog2.

public class KafkaTransport extends ThrottleableTransport {
    public static final String GROUP_ID = "graylog2";
    ...

Possible Solution

Allow user to supply the name through UI for each Kafka input and get rid of the default one whatsoever.

Steps to Reproduce (for bugs)

  1. Create any Kafka input.
  2. Kafka consumer will connect with consumer group id graylog2.

Context

If you have more than one Graylog setup inside a company and someone else connects to the same Kafka topic it might be troublesome. Also some ops teams may not allow generic customer group ids like graylog2.

Your Environment

  • Graylog Version:
    2.2.3

@joschi joschi added the feature label Jul 4, 2017

@lpiet

This comment has been minimized.

Copy link

commented Nov 2, 2018

I can confirm running into the problem in real life. Another team subscribed to our kafka and "stole" some of our logging before we caught on to the problem and switched the inputs off.

In addition it would make migrating a team of a shared graylog to a dedicated one a lot easier if two graylog instances could both consume from the same kafka in parrallel for a while to build up some logging history.

@jhaohai

This comment has been minimized.

Copy link

commented Nov 8, 2018

+1
We have two graylog clusters and need to subscribe logs from the same kafka cluster.

@bernd bernd closed this in dd5c025 Apr 17, 2019

@bernd bernd referenced this issue Apr 17, 2019
0 of 6 tasks complete
@bernd

This comment has been minimized.

Copy link
Member

commented Apr 17, 2019

This has been implemented in #5867 and will be part of Graylog 3.1.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
6 participants
You can’t perform that action at this time.