Skip to content
This repository

Fluentd data collector

Fetching latest commit…

Octocat-spinner-32-eaf2f5

Cannot retrieve the latest commit at this time

Octocat-spinner-32 bin
Octocat-spinner-32 lib
Octocat-spinner-32 .gitignore
Octocat-spinner-32 AUTHORS first commit June 19, 2011
Octocat-spinner-32 COPYING first commit June 19, 2011
Octocat-spinner-32 ChangeLog
Octocat-spinner-32 Makefile.am
Octocat-spinner-32 README.rdoc
Octocat-spinner-32 Rakefile
Octocat-spinner-32 VERSION
Octocat-spinner-32 autogen.sh
Octocat-spinner-32 configure.in
Octocat-spinner-32 fluent.conf
Octocat-spinner-32 make_dist.sh
README.rdoc

Fluent

Fluent is an event collector system. It's said that Fluent is generalized version of syslogd, which can deal with JSON object for the log message.

Archtecture

Fluent collects events from various data sources and write them to files, database or other storages:

Web apps  ---+                +--> file
             |                |
             +-->          ---+
/var/log  ------>  fluent  ------> mail
             +-->          ---+
             |                |
apache    ----                +--> fluent

Fluent also supports log transfer:

Web server
+--------+
| fluent -------
+--------+|     |
 +--------+     |
                |
Proxy server    |    Log server, Amazon S3, HDFS, ...
+--------+      +--> +--------+
| fluent ----------> | fluent ||
+--------+|     +--> +--------+|
 +--------+     |     +--------+
                |
Database server |
+--------+      |
| fluent ---------> mail
+--------+|
 +--------+

An event consists of tag, time and record. Tag is a string separated with '.' (e.g. myapp.access). It is used to categorize events. Time is a UNIX time when the event occurs. Record is a JSON object.

Quick Start

$ gem install fluent
$ fluentd &
$ echo '{"json":"message"}' | fluent-cat debug.test

Web site

fluent.github.com/

Documents

fluent.github.com/doc/

Source repository

github.com/fluent

Author

Sadayuki Furuhashi

Copyright

© 2011 FURUHASHI Sadayuki

License

Apache License, Version 2.0

Something went wrong with that request. Please try again.