This package implements a Hadoop org.apache.hadoop.metrics.spi.MetricContext for sending metric data to collectd.
Set the classpath in conf/hadoop-env.sh:
export HADOOP_CLASSPATH=collectd.jar:hadoop-collectd.jar
Set the context, collection period and collectd servers in conf/hadoop-metrics.properties:
# Configuration of the "dfs" context for collectd
dfs.class=org.apache.hadoop.metrics.collectd.CollectdContext
dfs.period=10
dfs.servers=239.192.74.66:25826
# Configuration of the "mapred" context for collectd
mapred.class=org.apache.hadoop.metrics.collectd.CollectdContext
mapred.period=10
mapred.servers=239.192.74.66:25826
# Configuration of the "jvm" context for collectd
jvm.class=org.apache.hadoop.metrics.collectd.CollectdContext
jvm.period=10
jvm.servers=239.192.74.66:25826
hadoop - Hadoop project
hadoop-collectd - git repo
collectd - the system statistics collection daemon
jcollectd - Java integration for collectd
LICENSE - Apache License, Version 2.0
Hadoop Users core-user@hadoop.apache.org - Feedback