Skip to content


Subversion checkout URL

You can clone with
Download ZIP
Mirror of Apache Flume
Java PowerShell Shell Python Thrift Protocol Buffer
Latest commit 88b3fee @jarcec jarcec FLUME-2841: Upgrade commons-collections to 3.2.2
(Hari Shreedharan via Jarek Jarcec Cecho)
Failed to load latest commit information.
bin FLUME-2763. flume_env script should handle jvm parameters like -javaa…
conf FLUME-2148. Windows : Add flume-env.ps1
dev-support FLUME-1787. Implement Pre-commit testing with Jenkins.
flume-ng-auth FLUME-2749. Fix kerberos configuration error when using short names i…
flume-ng-channels FLUME-2781. Kafka Channel with parseAsFlumeEvent=true should write da…
flume-ng-clients FLUME-2675. Update pom.xml version in trunk and 1.7 branch
flume-ng-configuration FLUME-2498. Implement Taildir Source
flume-ng-core FLUME-2712. Optional channel errors slows down the Source to Main cha…
flume-ng-dist FLUME-2498. Implement Taildir Source
flume-ng-doc FLUME-2498. Implement Taildir Source
flume-ng-embedded-agent FLUME-2675. Update pom.xml version in trunk and 1.7 branch
flume-ng-legacy-sources FLUME-2675. Update pom.xml version in trunk and 1.7 branch
flume-ng-node FLUME-2675. Update pom.xml version in trunk and 1.7 branch
flume-ng-sdk FLUME-2675. Update pom.xml version in trunk and 1.7 branch
flume-ng-sinks FLUME-2835. Hive Sink tests need to create table with transactional p…
flume-ng-sources FLUME-2773. TailDirSource throws FileNotFound Exception if ~/.flume d…
flume-ng-tests FLUME-2675. Update pom.xml version in trunk and 1.7 branch
flume-tools FLUME-2679. Make hbase-1 the default profile
.gitignore FLUME-2206. ElasticSearchSink ttl field modification to mimic Elastic…
CHANGELOG FLUME-2690. Update ChangeLog for 1.6 Release
DEVNOTES Add MAVEN_OPTS build workaround to DEVNOTES for 1.2.0
LICENSE FLUME-2683. Update License file for 1.6 release
NOTICE Updated copyright year in NOTICE file.
README FLUME-1719. Example export command in README do not properly close th…
RELEASE-NOTES FLUME-2676. Update flume docs and release notes to 1.7-SNAPSHOT in tr…
doap_Flume.rdf FLUME-2365. Add DOAP file for Flume.
pom.xml FLUME-2841: Upgrade commons-collections to 3.2.2


h1. Welcome to Apache Flume!

Apache Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of log data. It has a simple
and flexible architecture based on streaming data flows. It is robust and fault
tolerant with tunable reliability mechanisms and many failover and recovery
mechanisms. The system is centrally managed and allows for intelligent dynamic
management. It uses a simple extensible data model that allows for online
analytic application.

The Apache Flume 1.x (NG) code line is a refactoring of the first generation
Flume to solve certain known issues and limitations of the original design.

Apache Flume is open-sourced under the Apache Software Foundation License v2.0.

h2. Documentation

Documentation is included in the binary distribution under the docs directory.
In source form, it can be found in the flume-ng-doc directory.

The Flume 1.x guide and FAQ are available here:


h2. Contact us!

* Mailing lists:
* IRC channel #flume on

Bug and Issue tracker.


h2. Compiling Flume

Compiling Flume requires the following tools:

* Oracle Java JDK 1.6
* Apache Maven 3.x

Note: The Apache Flume build requires more memory than the default configuration.
We recommend you set the following Maven options:

export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=512m"

To compile Flume, run `mvn compile`.
To build a distribution, run `mvn install`.

The final Flume distribution artifacts will be in $project/flume-ng-dist/target/.
Something went wrong with that request. Please try again.