/flume

WE HAVE MOVED to Apache Incubator. https://cwiki.apache.org/FLUME/ . Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms an…
  1. Java 97.7%
  2. Shell 1.3%
  3. Other 1.0%
Java Shell Other
Clone or download

Clone with HTTPS

Use Git or checkout with SVN using the web URL.

Open in Desktop Download ZIP
Find file
Switch branches/tags
Nothing to show
Latest commit 1d75356 Sep 10, 2011 @jmhsieh jmhsieh Update to point to apache.
Permalink
Failed to load latest commit information.
bin FLUME-677: Update build instructions in devnotes Jun 27, 2011
conf FLUME-682: Improve SeqfileEventSink performance Jun 28, 2011
contrib/flogger FLUME-669: Changes required for recent Thrift IDL and Makefile update… Jun 20, 2011
docs/man FLUME-630: Maven builds breaks doc build May 25, 2011
flume-config-web Update to 0.9.5-SNAPSHOT Jun 18, 2011
flume-core FLUME-722: RegexAllExtractor doesn't ignore empty groups (Mingjie Lai) Aug 9, 2011
flume-distribution FLUME-701: Make flume project tar generated contents live inside ./fl… Jul 21, 2011
flume-docs FLUME-603: Revisit Performance tests Jun 30, 2011
flume-log4j-appender FLUME-620: Collector fails due to an infinite loop during file-rollin… Jun 27, 2011
flume-microbenchmarks FLUME-603: Revisit Performance tests Jun 30, 2011
flume-node-web Update to 0.9.5-SNAPSHOT Jun 18, 2011
flume-windows-dist Update to 0.9.5-SNAPSHOT Jun 18, 2011
plugins Update to 0.9.5-SNAPSHOT Jun 18, 2011
src/javatest-torture/com/cloudera/flume FLUME-603: Move to flume-microbenchmarks dir Jun 30, 2011
test-endtoend FLUME-418: Add batching and compression arguments to agent and collec… May 9, 2011
.gitignore FLUME-677: Update build instructions in devnotes Jun 27, 2011
CHANGELOG.html Bump to v0.9.3 Feb 6, 2011
DEVNOTES FLUME-716: Add ability to exclude or include arbitrary tests to maven… Jul 22, 2011
LICENSE CDH-1531: Add some more legalese (LICENSE, NOTICE) Jun 28, 2010
NOTICE CDH-1531: Add some more legalese (LICENSE, NOTICE) Jun 28, 2010
README Update to point to apache. Sep 10, 2011
RELEASENOTES FLUME-499: Names of incomplete files being written to hdfs should ind… Jul 1, 2011
findbugsExclude.xml Initial commit Jun 19, 2010
ivysettings.xml FLUME-467: Merge cloudera/hbase with trunk cloudera/master Apr 21, 2011
pmd.xml FLUME-291: Integrate PMD optionally into the build (ant pmd). Nov 10, 2010
pom.xml FLUME-716: Add ability to exclude or include arbitrary tests to maven… Jul 22, 2011

README 

h1. Welcome to Flume!

NOTE: We have moved to the Apache Incubator. https://cwiki.apache.org/FLUME/

Flume is a distributed, reliable, and available service for
efficiently collecting, aggregating, and moving large amounts of log
data. It has a simple and flexible architecture based on streaming
data flows. It is robust and fault tolerant with tunable reliability
mechanisms and many failover and recovery mechanisms. The system is
centrally managed and allows for intelligent dynamic management. It
uses a simple extensible data model that allows for online analytic
application

Flume is open-sourced under the Apache Software Foundation License v2.0.  

h2.  Documentation

https://cwiki.apache.org/FLUME/


h2. Contact us!


* User mailing list: flume-user@incubator.apache.org
* Developer mailling list: flume-dev@incubator.apache.org
* Instructions on how to subscribe to mailing list https://cwiki.apache.org/FLUME/mailing-lists.html
* IRC channel #flume on irc.freenode.net

Bug and Issue tracker.

* https://issues.apache.org/jira/browse/FLUME

h2. Compiling Flume

Compiling Flume requires the following tools:

* Java JDK 1.6
* Apache Maven

To compile Flume, run `mvn compile`.
To build a distribution, run `mvn package`.

The final Flume distribution artifact will be in $project/flume-distribution/target/.