Skip to content
Mirror of Apache Flume
Java PowerShell Shell Python Thrift Protocol Buffer
Latest commit f4f15be May 27, 2016 @mpercy mpercy FLUME-2913. Don't strip SLF4J from imported classpaths
It is no longer necessary to strip other versions of SLF4J from
classpaths imported from hadoop or hbase. With recent versions of SLF4J,
when multiple connectors are found, one of them "wins" and the logging
does not break. A warning is printed once, however. This is acceptable
because having too long of a classpath can cause major problems on
systems with a low ARG_MAX.

(Bessenyei Balázs Donát via Mike Percy)
Failed to load latest commit information.
bin FLUME-2913. Don't strip SLF4J from imported classpaths May 27, 2016
conf FLUME-2148. Windows : Add flume-env.ps1 Apr 14, 2015
dev-support FLUME-1787. Implement Pre-commit testing with Jenkins. Mar 21, 2013
flume-ng-auth FLUME-2749. Fix kerberos configuration error when using short names i… Jul 27, 2015
flume-ng-channels FLUME-2823: Flume-Kafka-Channel with new APIs Mar 29, 2016
flume-ng-clients FLUME-2675. Update pom.xml version in trunk and 1.7 branch Apr 15, 2015
flume-ng-configuration FLUME-2498. Implement Taildir Source Aug 17, 2015
flume-ng-core FLUME-2908: NetcatSource - SocketChannel not closed when session is b… May 5, 2016
flume-ng-dist FLUME-2498. Implement Taildir Source Aug 18, 2015
flume-ng-doc FLUME-2852: Kafka Source/Sink should optionally read/write Flume records Apr 21, 2016
flume-ng-embedded-agent FLUME-2675. Update pom.xml version in trunk and 1.7 branch Apr 16, 2015
flume-ng-legacy-sources FLUME-2675. Update pom.xml version in trunk and 1.7 branch Apr 16, 2015
flume-ng-node FLUME-2675. Update pom.xml version in trunk and 1.7 branch Apr 16, 2015
flume-ng-sdk FLUME-2675. Update pom.xml version in trunk and 1.7 branch Apr 16, 2015
flume-ng-sinks FLUME-2852: Kafka Source/Sink should optionally read/write Flume records Apr 21, 2016
flume-ng-sources FLUME-2852: Kafka Source/Sink should optionally read/write Flume records Apr 21, 2016
flume-ng-tests FLUME-2675. Update pom.xml version in trunk and 1.7 branch Apr 16, 2015
flume-tools FLUME-2679. Make hbase-1 the default profile Apr 17, 2015
.gitignore FLUME-2206. ElasticSearchSink ttl field modification to mimic Elastic… Oct 30, 2013
CHANGELOG FLUME-2690. Update ChangeLog for 1.6 Release May 5, 2015
DEVNOTES Add MAVEN_OPTS build workaround to DEVNOTES for 1.2.0 Jul 11, 2012
LICENSE FLUME-2683. Update License file for 1.6 release Apr 20, 2015
NOTICE Updated copyright year in NOTICE file. Jul 8, 2012
README FLUME-1719. Example export command in README do not properly close th… Nov 17, 2012
RELEASE-NOTES FLUME-2676. Update flume docs and release notes to 1.7-SNAPSHOT in tr… Apr 15, 2015
doap_Flume.rdf FLUME-2365. Add DOAP file for Flume. Jun 13, 2014
pom.xml FLUME-2909. Upgrade RAT to 0.11 May 18, 2016

README

h1. Welcome to Apache Flume!

Apache Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of log data. It has a simple
and flexible architecture based on streaming data flows. It is robust and fault
tolerant with tunable reliability mechanisms and many failover and recovery
mechanisms. The system is centrally managed and allows for intelligent dynamic
management. It uses a simple extensible data model that allows for online
analytic application.

The Apache Flume 1.x (NG) code line is a refactoring of the first generation
Flume to solve certain known issues and limitations of the original design.

Apache Flume is open-sourced under the Apache Software Foundation License v2.0.

h2. Documentation

Documentation is included in the binary distribution under the docs directory.
In source form, it can be found in the flume-ng-doc directory.

The Flume 1.x guide and FAQ are available here:

* https://cwiki.apache.org/FLUME/flume-ng.html
* https://cwiki.apache.org/confluence/display/FLUME/Getting+Started

h2. Contact us!

* Mailing lists: https://cwiki.apache.org/confluence/display/FLUME/Mailing+Lists
* IRC channel #flume on irc.freenode.net

Bug and Issue tracker.

* https://issues.apache.org/jira/browse/FLUME

h2. Compiling Flume

Compiling Flume requires the following tools:

* Oracle Java JDK 1.6
* Apache Maven 3.x

Note: The Apache Flume build requires more memory than the default configuration.
We recommend you set the following Maven options:

export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=512m"

To compile Flume, run `mvn compile`.
To build a distribution, run `mvn install`.

The final Flume distribution artifacts will be in $project/flume-ng-dist/target/.
Something went wrong with that request. Please try again.