-
Notifications
You must be signed in to change notification settings - Fork 2.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Broker Metrics not being shown up in the UI #186
Comments
I ran across the same issue with a 3 node cluster. |
Do you have JMX enabled for kafka brokers? If so, did you enable JMX polling in the configuration of the cluster in Kafka Manager? |
I do not have JMX enabled. Is this a requirement? |
Yes, I have JMX enabled for the brokers and also have enabled jmx polling On Sun, Feb 14, 2016 at 6:34 AM, Ryan Phillips notifications@github.com
|
@rphillips Yes, you need to enable JMX for metrics. No other way right now. @suhas22 What version of Kafka? |
Hi, On Mon, Feb 15, 2016 at 10:14 AM, patelh notifications@github.com wrote:
|
@suhas22 Do you see any errors in the logs? Are you using 0.8.2.0, 0.8.2.1, or 0.8.2.2 ? |
Hi, On Tue, Feb 16, 2016 at 5:52 AM, patelh notifications@github.com wrote:
|
Are you using Oracle JDK8 or OpenJDK8 ? |
Oracle JDK8 |
Hm, it is odd that you don't see any exceptions related to connecting to JMX or something similar. Are you able to connect to the broker and see the metrics using JConsole ? Did you configure a custom metrics reporter in your kafka server.properties ? |
I have a distributed system setup all on cloud, am running kafka manager on When i access the kafka manager UI, it lists all the brokers that the On Wed, Feb 17, 2016 at 12:57 PM, patelh notifications@github.com wrote:
|
Hi, [error] k.m.j.KafkaJMX$ - Failed to connect to service:jmx:rmi:///jndi/rmi://kafka-2-broker-24:9997/jmxrmi And here is the screenshot of my kafka process and port 9997 opened up and kafka is listening to it. |
The more I see the error, I get to think it's due to the Java version difference. |
I had a similar problem. The cause is the initial port 9997 is just the port that starts the connection. After the initial connection JMX negotiates a random port and uses that for the rest of the communication. This article explains it better than I can: Unfortunately the solution is to open the entire range that it picks it's random port numbers from. |
JDK7_45(?) and later should support -Dcom.sun.management.jmxremote.rmi.port=xxxx so the RMI port is not randomly chosen (I have not yet tried this). |
Same here, as a newbie, setup a Open JDK 1.7.0_101 Kafka 0.9.0.1 cluster and started kafka manager with JMX enabled as I can see kafka-manager picked up the JMX port but the bytes is 0 everywere. tcp6 0 0 :::6980 :::* LISTEN Ok, found a problem, although the kafka-manager was showing the JMX_PORT does not necessarily mean it can connect and get metrics, I verified this by trying to connect manually from JVisualVM. I had to make this fix to get JMX working on JVisualVM.
|
the JMX server which is running on broker will open the RMI port, you might need to specify RMI port also if firewall is your concern ( For example,
|
adding -Djava.rmi.server.hostname option didn't change anything. It seems as if this option is not taking any effect. Please help. I also have the same scenario wherein I have 3 brokers and kafka-manager is able to read metrics only from the server on which it is running. |
@shades198 Did you found a fix around it ? |
I have the same issue #571 ; not sure why it is not working.... |
@shades198, @jimymodi what do you put in KAFKA_JMX_OPTS ? |
I enabled KAFKA_JMX_OPTS and the settings are followings: |
Hi Team,
First of all thanks for putting up a great application, it's really useful to understand what's going with 100 odd brokers that we have in our cluster :)
I am however facing a few issues while trying to view the broker metrics.
Brokers home page:
Topics home page :
I browsed through a couple of issues related to this, and it was said that the issue was resolved in the master build, but looks like it isn't.(#69)
Any help here would be greatly appreciated.
The text was updated successfully, but these errors were encountered: