Add metrics

[ggrossetie]

I think it would be nice to have metrics/stats about Kafka server (message rate, byte in rate, byte out rate...)

AFAIK metrics/stats are not stored in Zookeeper (Ref: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+data+structures+in+Zookeeper). Would you consider a pull request that retrieve metrics from Kafka server ? I could use the Kafka REST Proxy, JMX or ... ?

A simpler solution might be to get the consumer offset from curator/zookeeper /consumers/[groupId]/offsets/[topic]/[partitionId] ?

Wdyt ?

[patelh]

This would be great. Coming from JMX may be better since I'm not sure if the REST Proxy is part of the Apache Kafka distribution or just confluence.

[ggrossetie]

OK I will open a pull request to discuss implementation details.

[patelh]

@Mogztter Thanks for the contrib! We are using it for our cluster. Consumer offset watcher would be nice addition too ;)

[ggrossetie]

You're welcome! I'm glad that you find it useful :)
Le 5 mai 2015 7:28 AM, "patelh" notifications@github.com a écrit :

@Mogztter https://github.com/Mogztter Thanks for the contrib! We are
using it for our cluster. Consumer offset watcher would be nice addition
too ;)

—
Reply to this email directly or view it on GitHub
#32 (comment).

[ggrossetie]

I found out that Kafka (core) have an utility class to retrieve consumer offset: https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/tools/ConsumerOffsetChecker.scala

I will do some testing to integrate this utility class 😄

[drummerwolli]

can be closed, or? JXM Metrics are available now in KM ...

[ggrossetie]

Yes I think we can close this issue now. @patelh Wdyt ?

[patelh]

Sure.