Skip to content

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Newer
Older
100755 84 lines (57 sloc) 4.361 kb
20f236b update readme
Costin Leau authored
1 The [Spring for Apache Hadoop](http://www.springsource.org/spring-data/hadoop) provides extensions to [Spring](http://www.springsource.org/spring-core), [Spring Batch](http://www.springsource.org/spring-batch), and [Spring Integration](http://www.springsource.org/spring-integration) to build manageable and robust pipeline solutions around Hadoop.
7308054 @dsyer First working Job
dsyer authored
2
20f236b update readme
Costin Leau authored
3 Spring for Apache Hadoop extends Spring Batch by providing support for reading from and writing to HDFS, running various types of Hadoop jobs (Java MapReduce, Streaming, [Hive](http://hive.apache.org), [Pig](http://pig.apache.org)), [HBase](http://hbase.apache.org) and [Cascading](http://cascading.org) interactions. An important goal is to provide excellent support for non-Java based developers to be productive using Spring Hadoop and not have to write any Java code to use the core feature set.
7308054 @dsyer First working Job
dsyer authored
4
20f236b update readme
Costin Leau authored
5 Spring for Apache Hadoop also applies the familiar Spring programming model to Java MapReduce jobs by providing support for dependency injection of simple jobs as well as a POJO based MapReduce programming model that decouples your MapReduce classes from Hadoop specific details such as base classes and data types.
7308054 @dsyer First working Job
dsyer authored
6
9723fa8 + update readme
Costin Leau authored
7 # Docs
7308054 @dsyer First working Job
dsyer authored
8
9723fa8 + update readme
Costin Leau authored
9 You can find out more details from the [user documentation](http://static.springsource.org/spring-data/hadoop/docs/current/reference/) or by browsing the [javadocs](http://static.springsource.org/spring-data/hadoop/docs/current/api/). If you have ideas about how to improve or extend the scope, please feel free to contribute.
10
11 # Artifacts
12
83703ee + enable back titles
Costin Leau authored
13 * Maven:
9f28725 + add titles back
Costin Leau authored
14
55e05f9 + play with syntax
Costin Leau authored
15 ~~~~~ xml
3ce0e2d + update readme
Costin Leau authored
16 <dependency>
17 <groupId>org.springframework.data</groupId>
18 <artifactId>spring-data-hadoop</artifactId>
87ac0d3 + update version info
Costin Leau authored
19 <version>${version}</version>
3ce0e2d + update readme
Costin Leau authored
20 </dependency>
21
87ac0d3 + update version info
Costin Leau authored
22 <!-- used for nightly builds -->
3ce0e2d + update readme
Costin Leau authored
23 <repository>
24 <id>spring-maven-snapshot</id>
25 <snapshots><enabled>true</enabled></snapshots>
26 <name>Springframework Maven SNAPSHOT Repository</name>
07b1207 update README.md
Costin Leau authored
27 <url>http://repo.springsource.org/snapshot</url>
3ce0e2d + update readme
Costin Leau authored
28 </repository>
87ac0d3 + update version info
Costin Leau authored
29
30 <!-- used for milestone/rc releases -->
31 <repository>
32 <id>spring-maven-milestone</id>
33 <name>Springframework Maven Milestone Repository</name>
07b1207 update README.md
Costin Leau authored
34 <url>http://repo.springsource.org/milestone</url>
87ac0d3 + update version info
Costin Leau authored
35 </repository>
55e05f9 + play with syntax
Costin Leau authored
36 ~~~~~
9723fa8 + update readme
Costin Leau authored
37
83703ee + enable back titles
Costin Leau authored
38 * Gradle:
9f28725 + add titles back
Costin Leau authored
39
ec439f9 update readme
Costin Leau authored
40 Based on the artifact type, pick one of the repos below:
41
3ce0e2d + update readme
Costin Leau authored
42 ~~~~~ groovy
43 repositories {
07b1207 update README.md
Costin Leau authored
44 maven { url "http://repo.springsource.org/release" }
45 maven { url "http://repo.springsource.org/milestone" }
46 maven { url "http://repo.springsource.org/snapshot" }
3ce0e2d + update readme
Costin Leau authored
47 }
48
49 dependencies {
87ac0d3 + update version info
Costin Leau authored
50 compile "org.springframework.data:spring-data-hadoop:${version}"
3ce0e2d + update readme
Costin Leau authored
51 }
52 ~~~~~
cdbf02e @dsyer Add POJO sample to README
dsyer authored
53
07b1207 update README.md
Costin Leau authored
54 The latest milestone is _1.0.0.M1_
b329484 update Readme again
Costin Leau authored
55
87ac0d3 + update version info
Costin Leau authored
56 The latest nightly is _1.0.0.BUILD-SNAPSHOT_
57
d3362a7 + simplify the titles a bit
Costin Leau authored
58 # Building
1087f3d + more info into readme
Costin Leau authored
59
20f236b update readme
Costin Leau authored
60 Spring for Apache Hadoop uses Gradle as its build system. To build the system simply run:
1087f3d + more info into readme
Costin Leau authored
61
62 gradlew
63
64 from the project root folder. This will compile the sources, run the tests and create the artifacts.
b1536e5 update readme
Costin Leau authored
65 Note that by default, only the vanilla Hadoop tests are running - you can enable additional tests by adding the tasks `enableHBaseTests`, `enableHiveTests`, `enablePigTests` and `webHdfsTests` (or `enableAllTests` in short).
1087f3d + more info into readme
Costin Leau authored
66 You can disable all tests by skipping the `test` task:
67
68 gradlew -x test
69
d3362a7 + simplify the titles a bit
Costin Leau authored
70 # Contributing
71
72 Here are some ways for you to get involved in the community:
73
af6d283 update readme
Costin Leau authored
74 * Get involved with the Spring community on the Spring Community Forums. Please help out on the [forum](http://forum.springsource.org/forumdisplay.php?87-Hadoop) by responding to questions and joining the debate.
d3362a7 + simplify the titles a bit
Costin Leau authored
75 * Create [JIRA](https://jira.springframework.org/browse/SHDP) tickets for bugs and new features and comment and vote on the ones that you are interested in.
564291d add missing punctuation
Costin Leau authored
76 * Watch for upcoming articles on Spring by [subscribing](http://www.springsource.org/node/feed) to springframework.org.
d3362a7 + simplify the titles a bit
Costin Leau authored
77
9dd1c50 update contribution
Costin Leau authored
78 Github is for social coding: if you want to write code, we encourage contributions through pull requests from [forks of this repository](http://help.github.com/forking/). If you want to contribute code this way, read the Spring Framework [contributor guidelines] (https://github.com/SpringSource/spring-framework/blob/master/CONTRIBUTING.md).
ec439f9 update readme
Costin Leau authored
79
80 # Staying in touch
d3362a7 + simplify the titles a bit
Costin Leau authored
81
ec439f9 update readme
Costin Leau authored
82 Follow the project team ([Costin](http://twitter.com/costinl), [Mark](http://twitter.com/markpollack)) on Twitter. In-depth articles can be
83 found at the SpringSource [team blog](http://blog.springsource.org), and releases are announced via our [news feed](http://www.springsource.org/news-events).
Something went wrong with that request. Please try again.