Skip to content
Mirror of Apache Flume
Java PowerShell Shell Python Thrift Protocol Buffer
Latest commit c8c0f9b Jun 30, 2016 @mpercy mpercy Minor README tweaks
Failed to load latest commit information.
bin FLUME-2913. Don't strip SLF4J from imported classpaths May 27, 2016
conf FLUME-2148. Windows : Add flume-env.ps1 Apr 14, 2015
dev-support FLUME-1787. Implement Pre-commit testing with Jenkins. Mar 21, 2013
flume-checkstyle FLUME-2937. Integrate checkstyle for non-test classes Jun 29, 2016
flume-ng-auth FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-channels FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-clients FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-configuration FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-core FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-dist FLUME-2498. Implement Taildir Source Aug 17, 2015
flume-ng-doc FLUME-1899. Make SpoolDir work with subdirectories Jun 28, 2016
flume-ng-embedded-agent FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-legacy-sources FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-node FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-sdk FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-sinks FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-sources FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-ng-tests FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
flume-tools FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016
.gitignore FLUME-2206. ElasticSearchSink ttl field modification to mimic Elastic… Oct 30, 2013
CHANGELOG FLUME-2690. Update ChangeLog for 1.6 Release May 5, 2015
DEVNOTES Add MAVEN_OPTS build workaround to DEVNOTES for 1.2.0 Jul 11, 2012
LICENSE FLUME-2683. Update License file for 1.6 release Apr 20, 2015
NOTICE Updated copyright year in NOTICE file. Jul 8, 2012
README.md Minor README tweaks Jun 30, 2016
RELEASE-NOTES FLUME-2676. Update flume docs and release notes to 1.7-SNAPSHOT in tr… Apr 15, 2015
doap_Flume.rdf FLUME-2365. Add DOAP file for Flume. Jun 13, 2014
pom.xml FLUME-2937. Integrate checkstyle for non-test classes Jun 30, 2016

README.md

Welcome to Apache Flume!

Apache Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. The system is centrally managed and allows for intelligent dynamic management. It uses a simple extensible data model that allows for online analytic application.

The Apache Flume 1.x (NG) code line is a refactoring of the first generation Flume to solve certain known issues and limitations of the original design.

Apache Flume is open-sourced under the Apache Software Foundation License v2.0.

Documentation

Documentation is included in the binary distribution under the docs directory. In source form, it can be found in the flume-ng-doc directory.

The Flume 1.x guide and FAQ are available here:

Contact us!

Bug and Issue tracker.

Compiling Flume

Compiling Flume requires the following tools:

  • Oracle Java JDK 1.7
  • Apache Maven 3.x

Note: The Apache Flume build requires more memory than the default configuration. We recommend you set the following Maven options:

export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=512m"

To compile Flume and build a distribution tarball, run mvn install from the top level directory. The artifacts will be placed under flume-ng-dist/target/.

Something went wrong with that request. Please try again.