Skip to content

GraphiteInstrumentationService

Thomas Memenga edited this page Oct 29, 2013 · 3 revisions

GraphiteInstrumentationService

About

GraphiteInstrumentationService is an oozie service that will register itself with the internal oozie scheduler to push oozie internal metrics into graphite. See oozie instumentation for a complete description of the various types.

Example

How many tasks getting executed successfully, are failing or getting queued again immediately ?

graph data: derivative(oozie.counters.callablequeue.*)

callable queue Throughput

Installation & configuration

See HowToInstallOozieGraphite.

User Guide

GraphiteInstrumentationService will iterate thru all available instrumentation data and you can control by configuring your whitelist regex patterns and blacklist regex patterns which parts of the metrics tree you want to be pushed into graphite.

The service will only submit numeric metrics (omitting all "string/boolean" values (like oozie.version, config.dir , etc)).

Simply start with com.syscrest.oozie.graphite.GraphiteInstrumentationService.metrics.whitelist = .* and com.syscrest.oozie.graphite.GraphiteInstrumentationService.metrics.blacklist = (empty string) to get the full tree and then start to select and filter metrics that matters to you.

Be aware that you will not recieve the full tree immediately after startup ! Especially counter/timers related to workflow actions (like fs, map-reduce or java actions for example) will pop up after the first execution within a workflow.

Most of of the oozie instrumentation values are absolute numbers, so make sure to use the function derivative() in your graph definitions.

Further resources and use cases

Home