Skip to content


Repository files navigation

Kafka CodaHale Metrics Reporter + Riemann metrics consumer

The goals of this repo is to have an end to end working environment to provide the ability for systems (applications and infrastructure) to send their metrics/sensor data to Kafka and then to report on that data for both alerts and charts.

More about this project in this blog post

Quick up and running

Use Vagrant to get up and running.

  1. Install Docker
  2. Install Virtual Box

In the main metrics-kafka folder

  1. sudo ./
  2. ./gradlew test
  3. sudo ./

once this is done

  • Zookeeper will be running localhost:2181
  • Broker 1 on localhost:9092
  • Riemann on localhost:5555
  • Riemann dash on localhost:4567
  • All the tests in metrics/src/test/java/* and riemann/src/test/scala/* should pass

You can access the brokers, zookeeper, riemann and riemann-dash by their IP from your local without having to go into vm.


bin/ --broker-list localhost:9092 --topic

bin/ --zookeeper localhost:2181 --topic --from-beginning ./gradlew :psutil:installDependencies ./gradlew :metrics-test:run

Kafka Yammer Metrics reporting

In order to assemble jar for metrics yammer do the following steps:

  1. ./gradlew :yammer:jar
  2. put the jar from metrics-yammer/build/libs to libs dir in root kafka folder
  3. add "kafka.metrics.reporters=ly.stealth.kafka.metrics.KafkaBrokerReporter" to config/ in kafka root folder


Metrics produced to Kafka and consumers for monitoring them







No releases published


No packages published