Skip to content
This repository

Fluentd data collector

Fetching latest commit…

Octocat-spinner-32-eaf2f5

Cannot retrieve the latest commit at this time

Octocat-spinner-32 bin
Octocat-spinner-32 lib
Octocat-spinner-32 test
Octocat-spinner-32 .gitignore fixed autogen.sh October 21, 2011
Octocat-spinner-32 .rvmrc
Octocat-spinner-32 AUTHORS first commit June 19, 2011
Octocat-spinner-32 COPYING first commit June 19, 2011
Octocat-spinner-32 ChangeLog
Octocat-spinner-32 Gemfile
Octocat-spinner-32 README.rdoc
Octocat-spinner-32 Rakefile
Octocat-spinner-32 VERSION
Octocat-spinner-32 fluent.conf
Octocat-spinner-32 fluentd.gemspec
README.rdoc

Fluentd

Fluentd is an event collector system. It is a generalized version of syslogd, which handles JSON objects for its log messages.

Architecture

Fluentd collects events from various data sources and writes them to files, database or other types of storages:

Web apps  ---+                 +--> file
             |                 |
             +-->           ---+
/var/log  ------>  Fluentd  ------> mail
             +-->           ---+
             |                 |
Apache    ----                 +--> Fluentd

Fluent also supports log transfer:

Web server
+---------+
| Fluentd -------
+---------+|     |
 +---------+     |
                 |
Proxy server     |    Log server, Amazon S3, HDFS, ...
+---------+      +--> +---------+
| Fluentd ----------> | Fluentd ||
+---------+|     +--> +---------+|
 +---------+     |     +---------+
                 |
Database server  |
+---------+      |
| Fluentd ---------> mail
+---------+|
 +---------+

An event consists of tag, time and record. Tag is a string separated with '.' (e.g. myapp.access). It is used to categorize events. Time is a UNIX time recorded at occurrence of an event. Record is a JSON object.

Quick Start

$ gem install fluentd
$ # install sample configuration file to the directory
$ fluentd -s conf
$ fluentd -c conf/fluent.conf &
$ echo '{"json":"message"}' | fluent-cat debug.test

Meta

Web site

fluentd.org/

Documents

fluentd.org/doc/

Source repository

github.com/fluent

Discussion

groups.google.com/group/fluentd

Author

Sadayuki Furuhashi

Copyright

© 2011 FURUHASHI Sadayuki

License

Apache License, Version 2.0

Contributors:

Patches contributed by those people.

Something went wrong with that request. Please try again.