Clone of flume-ng for experimental work.
Java Other
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
bin FLUME-1586: File Channel should support verifying integrity of indivi… Jun 13, 2013
conf FLUME-1418. Improvement for Log4j configuration. Aug 7, 2012
dev-support FLUME-1787. Implement Pre-commit testing with Jenkins. Mar 22, 2013
flume-ng-channels FLUME-2060. Failure in TestLog.testReplaySucceedsWithUnusedEmptyLogMe… Jun 19, 2013
flume-ng-clients FLUME-2010. Support Avro records in Log4jAppender and the HDFS Sink. Jun 18, 2013
flume-ng-configuration FLUME-2043. JMS Source removed on failure to create configuration May 11, 2013
flume-ng-core FLUME-2048. Add an Avro container file deserializer for Spool Directo… Jun 19, 2013
flume-ng-dist FLUME-2070. Add a Flume Morphline Solr Sink. Jun 18, 2013
flume-ng-doc FLUME-2048. Add an Avro container file deserializer for Spool Directo… Jun 19, 2013
flume-ng-embedded-agent FLUME-1852. Issues with EmbeddedAgentConfiguration. Jan 25, 2013
flume-ng-legacy-sources FLUME-2009. Flume project throws error when imported into Eclipse IDE May 8, 2013
flume-ng-node FLUME-1262. Move doc generation to a different profile Apr 16, 2013
flume-ng-sdk FLUME-2083. Avro Source should not start if SSL is enabled and keysto… Jun 18, 2013
flume-ng-sinks Add the abiity to export one bucket per object to the HDFS sink. Jun 25, 2013
flume-ng-sources FLUME-1886. Add a JMS enum type to SourceType so that users don't nee… May 7, 2013
flume-ng-tests FLUME-2011. "mvn test" fails without package build Apr 26, 2013
flume-tools FLUME-1586: File Channel should support verifying integrity of indivi… Jun 13, 2013
.gitignore FLUME-1787. Implement Pre-commit testing with Jenkins. Mar 22, 2013
CHANGELOG FLUME-1752: Update CHANGELOG for flume 1.3.0 rc6 to include latest ch… Nov 29, 2012
DEVNOTES Add MAVEN_OPTS build workaround to DEVNOTES for 1.2.0 Jul 11, 2012
LICENSE FLUME-1736: JSR-305.jar is listed as ASL2 when it's actually BSD-3 cl… Nov 21, 2012
NOTICE Updated copyright year in NOTICE file. Jul 8, 2012
README FLUME-1719. Example export command in README do not properly close th… Nov 18, 2012
RELEASE-NOTES FLUME-1698: Update RELEASE-NOTES Nov 12, 2012
pom.xml FLUME-2048. Add an Avro container file deserializer for Spool Directo… Jun 19, 2013

README

h1. Welcome to Apache Flume!

Apache Flume is a distributed, reliable, and available service for efficiently
collecting, aggregating, and moving large amounts of log data. It has a simple
and flexible architecture based on streaming data flows. It is robust and fault
tolerant with tunable reliability mechanisms and many failover and recovery
mechanisms. The system is centrally managed and allows for intelligent dynamic
management. It uses a simple extensible data model that allows for online
analytic application.

The Apache Flume 1.x (NG) code line is a refactoring of the first generation
Flume to solve certain known issues and limitations of the original design.

Apache Flume is open-sourced under the Apache Software Foundation License v2.0.

h2. Documentation

Documentation is included in the binary distribution under the docs directory.
In source form, it can be found in the flume-ng-doc directory.

The Flume 1.x guide and FAQ are available here:

* https://cwiki.apache.org/FLUME/flume-ng.html
* https://cwiki.apache.org/confluence/display/FLUME/Getting+Started

h2. Contact us!

* Mailing lists: https://cwiki.apache.org/confluence/display/FLUME/Mailing+Lists
* IRC channel #flume on irc.freenode.net

Bug and Issue tracker.

* https://issues.apache.org/jira/browse/FLUME

h2. Compiling Flume

Compiling Flume requires the following tools:

* Oracle Java JDK 1.6
* Apache Maven 3.x

Note: The Apache Flume build requires more memory than the default configuration.
We recommend you set the following Maven options:

export MAVEN_OPTS="-Xms512m -Xmx1024m -XX:PermSize=256m -XX:MaxPermSize=512m"

To compile Flume, run `mvn compile`.
To build a distribution, run `mvn install`.

The final Flume distribution artifacts will be in $project/flume-ng-dist/target/.