GitHub - apache/crunch: Mirror of Apache Crunch (Incubating)

This repository has been archived by the owner on Feb 26, 2024. It is now read-only.

Name		Name	Last commit message	Last commit date
Latest commit History 1,093 Commits
crunch-archetype		crunch-archetype
crunch-contrib		crunch-contrib
crunch-core		crunch-core
crunch-dist		crunch-dist
crunch-examples		crunch-examples
crunch-hbase		crunch-hbase
crunch-hcatalog		crunch-hcatalog
crunch-hive		crunch-hive
crunch-kafka		crunch-kafka
crunch-lambda		crunch-lambda
crunch-scrunch		crunch-scrunch
crunch-spark		crunch-spark
crunch-test		crunch-test
src/main/config		src/main/config
.gitignore		.gitignore
LICENSE		LICENSE
NOTICE		NOTICE
README		README
doap.rdf		doap.rdf
pom.xml		pom.xml

Repository files navigation

Welcome to Apache Crunch!
=========================

Apache Crunch is a Java library for writing, testing, and running Hadoop
MapReduce pipelines, based on Google's FlumeJava. Its goal is to make
pipelines that are composed of many user-defined functions simple to write,
easy to test, and efficient to run.

For more information please see the website:

  http://crunch.apache.org/


Building the Source Code
------------------------

We recommend Maven 3 and JDK 6 for building Crunch. To build the project
run the following Maven command:

  mvn package

To run the integration test suite and to install the created JARs in your
local Maven cache:

  mvn install