h1. Welcome to Apache Flume!

Apache Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of log data. It has a simple
and flexible architecture based on streaming data flows. It is robust and fault
tolerant with tunable reliability mechanisms and many failover and recovery
mechanisms. The system is centrally managed and allows for intelligent dynamic
management. It uses a simple extensible data model that allows for online
analytic application.

The Apache Flume 1.x (NG) code line is a refactoring of the first generation
Flume to solve certain known issues and limitations of the original design.

Apache Flume is open-sourced under the Apache Software Foundation License v2.0.

h2. Documentation

Documentation is included in the binary distribution under the docs directory.
In source form, it can be found in the flume-ng-doc directory.

The Flume 1.x guide and FAQ are available here:

* https://cwiki.apache.org/FLUME/flume-ng.html
* https://cwiki.apache.org/confluence/display/FLUME/Getting+Started

h2. Contact us!

* Mailing lists: https://cwiki.apache.org/confluence/display/FLUME/Mailing+Lists
* IRC channel #flume on irc.freenode.net

Bug and Issue tracker.

* https://issues.apache.org/jira/browse/FLUME

h2. Compiling Flume

Compiling Flume requires the following tools:

* Oracle Java JDK 1.6
* Apache Maven 3.x

Note: The Apache Flume build requires more memory than the default configuration.
We recommend you set the following Maven options:

export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=512m"

To compile Flume, run `mvn compile`.
To build a distribution, run `mvn install`.

The final Flume distribution artifacts will be in $project/flume-ng-dist/target/.

h2. Flume for Linux on Power

Environment:
Maven 3.2.3 from http://maven.apache.org/download.cgi
untar apache-maven-3.2.3-bin.tar.gz into /opt
and set:
export M2_HOME=/opt/apache-maven-3.2.3
export M2=$M2_HOME/bin
PATH=$M2:$PATH

Prerequisite:
Install hadoop 2.4.1 from ibmsoe repository https://github.com/ibmsoe/hadoop-common
#git clone https://github.com/ibmsoe/hadoop-common
#cd hadoop-common
#mvn install -Pnative -DskipTests -Drequire.snappy

Setting:
export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=512m"
umask 0022
ulimit -n 9000
ulimit -u 63017
export JAVA_HOME=/home/jdk/ibm/ibm-java-ppc64-71 (with JVM IBM for RHEL 7)

Build Flume for Linux on Power:
extract flume sources from https://github.com/ibmsoe/flume
#git clone https://github.com/ibmsoe/flume.git
#cd flume
#mvn clean
#mvn compile -Dhadoop.profile=2
#mvn install -DskipTests -Dhadoop.profile=2

Test Flume for Linux on Power:
#mvn test -fn -Dhadoop.profile=2