Skip to content

An implementation of Brendan Gregg's USE method in dtrace & kstat, which allow for historical collection of data on SmartOS. Perfect for analysis of cloud machines running @joyent and @LuceraHQ

master
Go to file
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 

README.md

dtrace / kstat statistic services

Copyright (c) 2013 Lucera Financial Infrastructures http://lucerahq.com

general

The included code source makes up the various components of a monitoring service that can be run on SmartOS machines, such as those running on the Joyent Public Cloud (www.joyent.com) or on Lucera (www.luceraHQ.com).

In general, the service is made of two parts, the generator and the collector.

The generator runs as a background process and queries kernel statistics while running DTrace scripts or Kstats outputs. The gathered information is wrapped into protocol buffers by zone and broadcast using the ZMQ publish method. The collector also runs as a background process and collectors the zone data as published by the generator. It saves the collected information into databases for later access and querying.

alt text

The source for the generator is included in the ./server folder of this directory. Two versions that can be used as collector are included in the ./fastbit and ./redis directories.

A shell script that will automatically install the generator and the FastBit collector is included in this directory. It can be downloaded and run by using

curl https://raw.github.com/luceracloud/dtrace_monitor/master/install.sh > install.sh
sh install.sh

Alternatively, to install only the generator, run

curl https://raw.github.com/luceracloud/dtrace_monitor/master/server/install.sh > install.sh
sh install.sh

Similarly, to install only the listener, run

curl https://raw.github.com/luceracloud/dtrace_monitor/master/fastbit/install.sh > install.sh
sh install.sh

Note that the build process for the dependencies (especially FastBit) may take a long time.

Directions for how to run the generator and collector can be found in their respective directories.

Related dependencies and build information for code below can be found in README files in respective directories.


server (generator)

Source code for statistics server. This program collects statistics from both kstat and custom DTrace scripts, encodes them using Google's Protocol Buffers and ZMQ, then broadcasts over a user-specified port.

fastbit (listener)

Source code for FastBit-based collector. Listens to statistics server (see here) and aggregates data by IP-zone.

scripts/cpu

Repository of DTrace scripts that run in the non-global zone and allow you to trace potential CPU/process performance issues.

scripts/misc

Repository of DTrace scripts and kstat shell scripts that can be run in the non-global zone that perform various miscellaneous functions.

scripts/net

Repository of kstat shell scripts that allow for monitoring of network resources for identification of potential problems.

About

An implementation of Brendan Gregg's USE method in dtrace & kstat, which allow for historical collection of data on SmartOS. Perfect for analysis of cloud machines running @joyent and @LuceraHQ

Resources

License

Releases

No releases published

Packages

No packages published
You can’t perform that action at this time.