Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP

Puts ganglia gmond information on a zeromq pub/sub

branch: master

Fetching latest commit…

Octocat-spinner-32-eaf2f5

Cannot retrieve the latest commit at this time

Octocat-spinner-32 bin
Octocat-spinner-32 lib
Octocat-spinner-32 spec
Octocat-spinner-32 .gitignore
Octocat-spinner-32 .rvmrc
Octocat-spinner-32 Gemfile
Octocat-spinner-32 Gemfile.lock
Octocat-spinner-32 Guardfile
Octocat-spinner-32 README.md
Octocat-spinner-32 Rakefile
README.md

What is this project about:

There is not one monitoring project to rule them all:

Ganglia, Graphite, Collectd, Opentsdb, ... they all have their specific unique functionality and their associate unique storage.

Instead of trying to create one central storage, we want to send the different metric information, to each monitoring solution for their optimized function.

This project's code will:

  • listen into the gmond UDP protocol
  • optionally poll existing gmond's and put the message on to a 0mq (pub/sub).

From there, other subscribers can pull the information into graphite, collectd, opentsdb etc..

We have deliberately chosen not to go for peer to peer communication, but for a bus/queue oriented system.

It currently doesn't do more than put things on the queue, the next step is to write subscribers for the other monitoring systems.

And maybe , just maybe, this will evolve into a swiss-army knife of monitoring/metrics conversion ....

Thanks!

A big thanks to Vladimir Vuksan (@vvuksan) for helping me out with the original proof of concept!

Requirements:

Centos

# yum install libxml2-devel
# yum install libxslt-devel
# yum install zeromq-devel
# yum install uuid-devel
# yum install json-c-devel

Configuring gmond

Just add another udp send channel for your existing gmond's

udp_send_channel {
    host = 127.0.0.1
    port = 1234
}

Running it:

gmond-zmq - A gmond UDP receiver that pushes things to a 0mq Pub/Sub

Usage: gmond-zmq [-p port] [-P file] [-d] [-k]
gmond-zmq --help

  -p, --port PORT           Specify port
(default: 1234)
  -P, --pid FILE            save PID in FILE when using -d option.
(default: /var/run/gmond-zmq.pid)
  -d, --daemon              Daemonize mode
  -k, --kill [PORT]         Kill specified running daemons - leave blank to kill all.
  -u, --user USER           User to run as
  -G, --group GROUP         Group to run as
  --gmond-host [HOST]   hostname/ip address of the gmond to poll
  --gmond-port [PORT]   tcp port of the gmond to poll
  --gmond-interval [seconds]
interval to poll the gmond, 0 = disable (default)
  --zmq-port [PORT]     tcp port of the zmq publisher
  --zmq-host [HOST]     hostname/ip address of the zmq publisher
  -v, --verbose             more verbose output
  -t, --test-zmq            Starts a test zmq subscriber
  -?, --help                Display this usage information.

Message examples

{"timestamp":1324639623,"payload":{"name":"machine_type","val":"x86_64","slope":"zero","dmax":"0","tn":"809","units":"","type":"string","tmax":"1200","hostname":"localhost"},"id":"f6412a10-0f86-012f-0bdb-080027701f72","context":"METRIC","source":"GMOND"}
{"timestamp":1324639623,"payload":{"name":"proc_total","val":"105","slope":"both","dmax":"0","tn":"89","units":" ","type":"uint32","tmax":"950","hostname":"localhost"},"id":"f6415250-0f86-012f-0bdc-080027701f72","context":"METRIC","source":"GMOND"}
{"timestamp":1324639623,"payload":{"name":"cpu_num","val":"1","slope":"zero","dmax":"0","tn":"809","units":"CPUs","type":"uint16","tmax":"1200","hostname":"localhost"},"id":"f6417410-0f86-012f-0bdd-080027701f72","context":"METRIC","source":"GMOND"}
{"timestamp":1324639623,"payload":{"name":"cpu_speed","val":"2800","slope":"zero","dmax":"0","tn":"809","units":"MHz","type":"uint32","tmax":"1200","hostname":"localhost"},"id":"f64186c0-0f86-012f-0bdf-080027701f72","context":"METRIC","source":"GMOND"}
{"timestamp":1324639623,"payload":{"name":"pkts_out","val":"3.27","slope":"both","dmax":"0","tn":"49","units":"packets/sec","type":"float","tmax":"300","hostname":"localhost"},"id":"f641aa00-0f86-012f-0be0-080027701f72","context":"METRIC","source":"GMOND"}
{"timestamp":1324639623,"payload":{"name":"swap_free","val":"741752","slope":"both","dmax":"0","tn":"89","units":"KB","type":"float","tmax":"180","hostname":"localhost"},"id":"f641c720-0f86-012f-0be1-080027701f72","context":"METRIC","source":"GMOND"}

Some inspiration:

Something went wrong with that request. Please try again.