Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BEAM-79] merge gearpump-runner into master #3611

Closed
wants to merge 207 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
207 commits
Select commit Hold shift + click to select a range
9478f41
[BEAM-79] add Gearpump runner
manuzhang Mar 15, 2016
02b2248
This closes #323
kennknowles Jul 20, 2016
2a0ba61
Merge branch master into gearpump-runner
kennknowles Aug 25, 2016
1672b54
move integration tests to profile
manuzhang Jul 23, 2016
276a2e1
add package-info.java
manuzhang Jul 28, 2016
40be715
Update Gearpump runner version to 0.3.0-incubating
kennknowles Aug 10, 2016
bc1b354
Rename DoFn to OldDoFn in Gearpump runner
manuzhang Aug 11, 2016
091a15a
This closess #750
kennknowles Aug 25, 2016
fb74c93
gearpump: switch to stable version
dhalperi Aug 26, 2016
bf0a2ed
Closes #895
dhalperi Aug 27, 2016
0dfb8ff
Made byteArrayCoder final static
Aug 10, 2016
b9f8263
CompressedSource: CompressedReader is never splittable
dhalperi Aug 11, 2016
011bea9
Do not add DataDisks to windmill service jobs.
drieber Aug 9, 2016
1d86335
Remove timeout in DirectRunnerTest
tgroh Aug 11, 2016
36a9aa2
Improve Write Error Message
tgroh Aug 9, 2016
d564155
Remove Streaming Write Overrides in DataflowRunner
tgroh Aug 9, 2016
89921c4
Remove Counter and associated code
Jul 29, 2016
7fc2c68
[BEAM-495] Create General Verifier for File Checksum
Aug 3, 2016
b47549e
Add output checksum to WordCountITOptions
Aug 3, 2016
37ce2a3
More unit test and code style fix
Aug 11, 2016
046e36e
Using IOChannelUtils to resolve file path
Aug 11, 2016
58cd781
Added unit tests and error handling in removeTemporaryTables
Aug 5, 2016
d99a652
[flink] add missing maven config to example pom
mxm Aug 12, 2016
39f763e
Remove DataflowPipelineJob from examples
peihe Aug 1, 2016
424c4c4
[BEAM-432] Corrected BigQueryIO javadoc
mariusz89016 Aug 13, 2016
b80d967
Add TransformEvaluatorFactory#cleanup
tgroh Jul 15, 2016
77c90d0
Replace CloningThreadLocal with DoFnLifecycleManager
tgroh Jul 19, 2016
d056f46
Add DoFn @Setup and @Teardown
tgroh Jul 14, 2016
6603307
Move ParDo Lifecycle tests to their own file
tgroh Aug 11, 2016
d6cf4f2
Exclude ParDoTest from Dataflow @RunnableOnService
dhalperi Aug 15, 2016
0f1f114
Exclude guava-testlib from shading relocation
swegner Aug 15, 2016
09cd1b7
ByteKeyRangeTracker: synchronize toString
dhalperi Aug 16, 2016
bd53cdc
Fix repackaging exclude pattern for guava-testlib
swegner Aug 17, 2016
cc189b4
Rewrites DoFnReflector to go via DoFnSignature
jkff Aug 10, 2016
da638b6
Replace ParDo with simpler transforms where possible
kennknowles Jul 27, 2016
235bf3b
Set Gcs upload buffer size to 1M in streaming mode in DataflowRunner
peihe Aug 15, 2016
530b9c0
addressed feedback
peihe Aug 17, 2016
aa541e7
fix unused imports
peihe Aug 17, 2016
bbd0e6b
DatastoreIO Sink as ParDo
vikkyrk Aug 15, 2016
245c3ce
Change name of result returned by BigQueryIO.Read
fyellin Aug 16, 2016
16bcf78
Fix NPE in BigQueryIO.TransformingReader
peihe Aug 16, 2016
178898f
Add inEarlyPanesInGlobalWindow as a PAssert Extractor
tgroh Aug 11, 2016
6c82321
Add TestStream to the Testing package
tgroh Aug 16, 2016
f37dba8
Implement TestStream in the DirectRunner
tgroh Aug 16, 2016
dab9efc
Incorporate private IP option for Dataflow runner
sammcveety Aug 18, 2016
a4053ac
Datastore Sink support for writing Mutations
vikkyrk Aug 18, 2016
c996c1e
Mark JAXBContext as Volatile in JAXBCoder
tgroh Aug 19, 2016
4ad78b2
Modify example dependencies to only add runners as optional dependenc…
lukecwik Aug 18, 2016
5c1b9f1
DatastoreIO v1beta3 to v1
vikkyrk Aug 19, 2016
c3c11b1
Remove unused constant in ExecutorServiceParallelExecutor
tgroh Aug 22, 2016
64a2d51
Remove extra timer firings in WatermarkManager
tgroh Aug 22, 2016
a60806a
FileBasedSink: improve parallelism in GCS copy/remove
dhalperi Aug 15, 2016
780ffcb
[BEAM-574] Remove log when new records have not been read yet (KafkaIO)
iemejia Aug 22, 2016
730e7b0
Write: Remove invalid import
dhalperi Aug 24, 2016
67efb17
JUnit tests: add @RunWith annotation
dhalperi Aug 24, 2016
438d8bd
Remove ParDoTest Suppression in Google Cloud Dataflow
tgroh Aug 23, 2016
67e095d
Fix Emission in startBundle/finishBundle in Flink Wrappers
aljoscha Jun 11, 2016
686a286
[BEAM-253] Unify Flink-Streaming Operator Wrappers
aljoscha Jun 11, 2016
9eef8a6
Fix Checkstyle Errors in FlinkStreamingTransformTranslators
aljoscha Jul 10, 2016
9179e93
[BEAM-102] Add Side Inputs in Flink Streaming Runner
aljoscha Jul 11, 2016
de744c5
Allow DoFn Reuse in ParDoTest.TestDoFnWithContext
aljoscha Jul 23, 2016
b4a38c3
Don't Suppress Throwable in PAssert in Streaming Mode
aljoscha Jul 24, 2016
7a2cccd
Fix Flink Runner Pom for Batch RunnableOnService tests
aljoscha Aug 20, 2016
f2a992e
Enable Flink Streaming Runner RunnableOnService tests
aljoscha Jul 26, 2016
a07b29f
Fix combine tests with Accumulation Mode
tgroh Jul 27, 2016
97e093c
Use AllPanes as the PaneExtractor in IterableAssert
tgroh Jul 28, 2016
b7ba1d6
Make ParDoLifecycleTest Serializable to Fix Test with TupleTag
aljoscha Aug 20, 2016
7012a22
Fix Exception Unwrapping in TestFlinkRunner
aljoscha Aug 20, 2016
93f7955
Update checkstyle.xml to put all imports in one group
Aug 24, 2016
00441f8
Optimize imports
Aug 24, 2016
8d32196
BigQueryIO.Write: raise size limit to 11 TiB
dhalperi Aug 24, 2016
186fe28
Cleanup some javadoc that referring Dataflow
peihe Aug 24, 2016
433842b
Move the samples data to gs://apache-beam-samples/
peihe Aug 25, 2016
32928c3
[BEAM-545] Promote JobName to PipelineOptions
peihe Aug 10, 2016
f05fbe7
Update DoFn javadocs to remove references to OldDoFn and Dataflow
swegner Aug 17, 2016
4ec73d8
Make WriteTest more resilient to Randomness
tgroh Aug 25, 2016
b3be7b7
checkstyle: prohibit API client repackaged Guava
dhalperi Aug 24, 2016
1f8b534
Modified BigtableIO to use DoFn setup/tearDown methods instead of sta…
Aug 15, 2016
5b425ac
[BEAM-294] Rename dataflow references to beam
jbonofre Aug 25, 2016
ef312e9
Added support for reporting aggregator values to Spark sinks
staslev Aug 26, 2016
0fbd9c8
travis.yml: disable updating snapshots
dhalperi Aug 24, 2016
79491eb
Query latest timestamp
vikkyrk Aug 23, 2016
4023167
[BEAM-589] Fixing IO.Read transformation
Aug 25, 2016
bce9aef
kinesis: a connector for Amazon Kinesis
przemekpastuszka Jul 18, 2016
aee5fbf
Organize imports in Kinesis
dhalperi Aug 26, 2016
973081e
Fix javadoc in Kinesis
dhalperi Aug 26, 2016
1c1115e
[BEAM-592] Fix SparkRunner Dependency Problem in WordCount
Aug 26, 2016
8454d5c
DataflowRunner: get PBegin from PInput
dhalperi Aug 27, 2016
07dd978
[BEAM-313] Provide a context for SparkRunner
amarouni Aug 29, 2016
435054b
Update Dataflow Container Version
tgroh Aug 26, 2016
cf9ce2f
[BEAM-572] Remove Spark Reference in WordCount
Aug 26, 2016
a58afd3
Returned KafkaIO getWatermark log line in debug mode
aviemzur Aug 28, 2016
74d0195
take advantage of setup/teardown for KafkaWriter
Aug 29, 2016
00b4e95
Add LeaderBoardTest
tgroh Aug 5, 2016
8007bdf
[BEAM-569] Define maxNumRecords default value to Long.MAX_VALUE in JmsIO
jbonofre Aug 27, 2016
6ae4b6a
Address comments of Flink Side-Input PR
aljoscha Aug 25, 2016
1524494
Fix condition in FlinkStreamingPipelineTranslator
aljoscha Aug 31, 2016
798566c
Correct some accidental renames
Aug 3, 2016
4251761
Test that multiple instances of TestStream are supported
tgroh Aug 30, 2016
28ad44d
Remove empty unused method in TestStreamEvaluatorFactory
tgroh Aug 31, 2016
6ee7b62
Add Latest CombineFn and PTransforms
swegner Aug 18, 2016
0312f15
DatastoreIO SplitQueryFn integration test
vikkyrk Aug 29, 2016
f44fa2c
Cloud Datastore naming clean-up
vikkyrk Sep 1, 2016
9943fd7
Fixed Combine display data
Aug 18, 2016
60d8cd9
Delegate populateDipslayData to wrapped combineFn's
swegner Aug 19, 2016
4bf3a3b
Put classes in runners-core package into runners.core namespace
kennknowles Aug 25, 2016
c92e45d
Remove the DataflowRunner instructions from examples
peihe Aug 25, 2016
3f48566
FluentBackoff: a replacement for a variety of custom backoff implemen…
dhalperi Aug 25, 2016
9ae5cc7
[BEAM-456] Add MongoDbIO
jbonofre Jul 15, 2016
5eb44aa
[BEAM-242] Enable checkstyle and fix checkstyle errors in Flink runner
jbonofre Aug 25, 2016
958f3fe
BigQuery: limit max job polling time to 1 minute
dhalperi Sep 4, 2016
c8052b6
Be more accepting in UnboundedReadDeduplicatorTest
tgroh Sep 2, 2016
8f68085
Remove timeout in JAXBCoderTest
tgroh Sep 6, 2016
50c1c88
[BEAM-242] Enable and fix checkstyle in Flink runner examples
jbonofre Sep 6, 2016
b235595
Add header/footer support to TextIO.Write
staslev Sep 5, 2016
1b420db
Revised according to comments following a code review.
staslev Sep 6, 2016
092a187
Reverted header and footer to be of type String.
staslev Sep 7, 2016
5084580
Added javadoc to TextIO#withHeader and TextIO#withFooter.
staslev Sep 7, 2016
e5db1c7
Added even more javadoc to TextIO#withHeader and TextIO#withFooter.
staslev Sep 7, 2016
34c731f
Added even more javadoc to TextIO#withHeader and TextIO#withFooter (2).
staslev Sep 7, 2016
6cd48c4
!fixup Minor javadoc clean-up
lukecwik Sep 7, 2016
59ae94c
fix import order
manuzhang Sep 12, 2016
ed7c4aa
Closes #943
dhalperi Sep 13, 2016
272fe9f
[BEAM-79] fix integration-test failure
manuzhang Sep 14, 2016
8f4334c
Closes #956
dhalperi Sep 14, 2016
9dc9be9
Merge branch 'master' into gearpump-runner
manuzhang Oct 26, 2016
8f013cb
post-merge fix
manuzhang Oct 26, 2016
94bd47c
remove "pipeline" in runner name
manuzhang Oct 26, 2016
3f06382
upgrade gearpump-runner to 0.4.0-incubating-SNAPSHOT
manuzhang Oct 26, 2016
3933b55
Closes #1193
dhalperi Oct 26, 2016
45570b9
[BEAM-79] Port Gearpump runner from OldDoFn to new DoFn
manuzhang Oct 31, 2016
323ec11
This closes #1234
kennknowles Nov 3, 2016
0c36228
Merge branch 'master' into gearpump-runner
manuzhang Nov 8, 2016
2a96a17
[BEAM-79] update GearpumpPipelineResult
manuzhang Nov 8, 2016
a14927f
This closes #1306
kennknowles Nov 8, 2016
68363d0
Merge branch 'master' of https://github.com/apache/incubator-beam int…
manuzhang Nov 12, 2016
2812405
Merge branch 'master' of https://github.com/apache/incubator-beam int…
manuzhang Nov 23, 2016
86414c0
Merge remote-tracking branch 'upstream/master' into gearpump-runner-sync
manuzhang Dec 5, 2016
2afc0cd
[BEAM-79] fix gearpump runner build failure
manuzhang Dec 6, 2016
88de0cb
This closes #1507
kennknowles Dec 6, 2016
46d3563
Upgrade Gearpump version
manuzhang Dec 16, 2016
85d54ab
Add Window.Bound translator
manuzhang Dec 16, 2016
c37de00
Skip window assignment when windows don't change
manuzhang Dec 16, 2016
cb8c5e5
Remove print to stdout
manuzhang Dec 16, 2016
8e0e819
Fix NoOpAggregatorFactory
manuzhang Dec 16, 2016
b6e7bb6
This closes #1623: [BEAM-1086] Upgrade to latest Gearpump snapshot
kennknowles Dec 16, 2016
81d94cf
Merge branch 'master' of https://github.com/apache/incubator-beam int…
manuzhang Dec 20, 2016
c2fb7c0
[BEAM-79] Update to latest Gearpump API
manuzhang Dec 20, 2016
647034c
[BEAM-79] Upgrade to beam-0.5.0-incubating-SNAPSHOT
manuzhang Dec 21, 2016
4c445dd
This closes #1663: Merge master (b3de17b) into gearpump-runner
kennknowles Dec 21, 2016
2155476
[BEAM-1180] Implement GearpumpPipelineResult
manuzhang Dec 20, 2016
cfdc971
update ROS configurations
manuzhang Jan 5, 2017
ea633d2
activate ROS on Gearpump by default
manuzhang Jan 7, 2017
e63d42d
fix group by window
manuzhang Jan 7, 2017
3bf8263
update to latest gearpump dsl function interface
manuzhang Jan 14, 2017
f6aaf0d
support OutputTimeFn
manuzhang Jan 14, 2017
364a3f0
return encoded key for GroupByKey translation
manuzhang Jan 16, 2017
b2d326f
fix ParDo.BoundMulti translation
manuzhang Jan 16, 2017
7613ec4
reduce timeout to wait for result
manuzhang Jan 16, 2017
85dcfbd
Remove cache for Gearpump on travis
manuzhang Jan 20, 2017
d814857
note thread is interrupted on InterruptedException
manuzhang Jan 20, 2017
1ed16f1
This closes #1661: Implement GearpumpPipelineResult
kennknowles Jan 24, 2017
4fd216b
[BEAM-79] Fix PostCommit test confs for Gearpump runner
manuzhang Jan 24, 2017
4001aeb
This closes #1828: Fix PostCommit test confs for Gearpump runner
kennknowles Jan 26, 2017
7af6472
[BEAM-79] Support merging windows in GearpumpRunner
manuzhang Feb 7, 2017
2d0aed9
This closes #1935: Support merging windows in GearpumpRunner
kennknowles Feb 15, 2017
4eb50d1
[BEAM-79] Add SideInput support for GearpumpRunner
manuzhang Feb 14, 2017
3dc8fc8
enable ParDoTest
manuzhang Mar 10, 2017
15a8ad6
This closes #2150: Add SideInput support for GearpumpRunner
kennknowles Mar 10, 2017
3f91798
Merge branch 'master' of https://github.com/apache/incubator-beam int…
manuzhang Mar 12, 2017
3eab6a6
[BEAM-79] Fix gearpump-runner merge conflicts and test failure
manuzhang Mar 14, 2017
555842a
This closes #2241: merge master to gearpump-master and fixup
kennknowles Mar 17, 2017
eb0d333
[BEAM-972] Add unit tests to Gearpump runner
huafengw Mar 21, 2017
f4f2333
This closes #2302: Add unit tests to Gearpump runner
kennknowles Mar 30, 2017
f3138dd
[BEAM-972] Add more unit test to Gearpump runner
huafengw Apr 12, 2017
ebbb613
This closes #2521: Add more unit test to Gearpump runner
kennknowles Apr 18, 2017
46c41fc
Merge branch 'master' of https://github.com/apache/incubator-beam int…
manuzhang Apr 20, 2017
44d21ac
Update gearpump-runner against master changes.
manuzhang Apr 20, 2017
4078c22
This closes #2610: Merge master into gearpump-runner branch
kennknowles Apr 21, 2017
9a59ea3
Merge remote-tracking branch 'upstream/master' into gearpump-runner
manuzhang May 3, 2017
12b9719
Update gearpump-runner against master changes
manuzhang May 4, 2017
58546ac
This closes #2888: Merge master into gearpump-runner branch
kennknowles May 4, 2017
bc8da29
Merge branch 'master' of https://github.com/apache/beam into sync-master
manuzhang May 18, 2017
6c06967
Update gearpump-runner against master changes
manuzhang May 18, 2017
99221e7
This closes #3172: Sync gearpump-runner with master
kennknowles May 18, 2017
9e6c906
Merge branch 'master' of https://github.com/apache/beam into sync-master
manuzhang Jun 5, 2017
c9aac96
Update against master changes
manuzhang Jun 5, 2017
3c7e3e6
Activate Gearpump local-validates-runner-tests in precommit
kennknowles May 18, 2017
98854d4
Respect WindowFn#getOutputTime in gearpump-runner
manuzhang May 19, 2017
7653e7e
Fix side input handling in DoFnFunction
manuzhang Jun 7, 2017
559e3c3
This closes #3292: Merge master into gearpump-runner
kennknowles Jun 12, 2017
fed98c8
Merge branch 'master' of https://github.com/apache/beam into sync-master
manuzhang Jun 17, 2017
f61822d
upgrade to gearpump 0.8.4-SNAPSHOT
manuzhang Jun 7, 2017
a7b5d98
Fix PCollectionView translation
manuzhang Jun 17, 2017
11caa97
Fix kryo exception
manuzhang Jun 19, 2017
b21fa04
Remove unused codes
manuzhang Jun 23, 2017
99f4f8b
This closes #3388: Sync gearpump-runner branch with master
kennknowles Jun 23, 2017
f158257
Merge branch 'master' of https://github.com/apache/beam into sync-master
manuzhang Jun 30, 2017
627ae0b
This closes #3479: [BEAM-79] Merge master into gearpump-runner branch
kennknowles Jun 30, 2017
c2d3fbc
Merge branch 'master' of https://github.com/apache/beam into sync-master
manuzhang Jul 7, 2017
2206827
Upgrade to gearpump 0.8.4
manuzhang Jul 7, 2017
725f547
Fix ParDoTest#testPipelineOptionsParameter
manuzhang Jul 7, 2017
1ce60b4
This closes #3515: Sync gearpump-runner with master and upgrade to ge…
kennknowles Jul 10, 2017
e655f53
Revert accidental changes to sdks/java/pom.xml
manuzhang Jul 21, 2017
daa7566
Upgrade BEAM version to 2.2.0-SNAPSHOT in gearpump-runner
manuzhang Jul 21, 2017
49d4ed5
Add beam-runners-gearpump dependency to javadoc
manuzhang Jul 21, 2017
b0ed584
Deactivate integration-tests for gearpump-runner by default
manuzhang Jul 25, 2017
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
Expand Up @@ -45,5 +45,5 @@ mavenJob('beam_PostCommit_Java_ValidatesRunner_Gearpump') {
'Run Gearpump ValidatesRunner')

// Maven goals for this job.
goals('-B -e clean verify -am -pl runners/gearpump -DforkCount=0 -DvalidatesRunnerPipelineOptions=\'[ "--runner=TestGearpumpRunner", "--streaming=false" ]\'')
goals('-B -e clean verify -am -pl runners/gearpump -DforkCount=0 -DvalidatesRunnerPipelineOptions=\'[ "--runner=TestGearpumpRunner"]\'')
}
Expand Up @@ -41,5 +41,5 @@ mavenJob('beam_PreCommit_Java_MavenInstall') {
common_job_properties.setPreCommit(delegate, 'Maven clean install')

// Maven goals for this job.
goals('-B -e -Prelease,include-runners,jenkins-precommit,direct-runner,dataflow-runner,spark-runner,flink-runner,apex-runner -DrepoToken=$COVERALLS_REPO_TOKEN -DpullRequest=$ghprbPullId help:effective-settings clean install coveralls:report')
goals('-B -e -Prelease,include-runners,jenkins-precommit,direct-runner,dataflow-runner,spark-runner,flink-runner,apex-runner,gearpump-runner -DrepoToken=$COVERALLS_REPO_TOKEN -DpullRequest=$ghprbPullId help:effective-settings clean install coveralls:report')
}
36 changes: 36 additions & 0 deletions examples/java/pom.xml
Expand Up @@ -89,6 +89,18 @@
</dependencies>
</profile>

<!-- Include the Apache Gearpump (incubating) runner with -P gearpump-runner -->
<profile>
<id>gearpump-runner</id>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Take a look in this file for the jenkins-precommit bits. You can add an execution for the Gearpump runner.

<dependencies>
<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-runners-gearpump</artifactId>
<scope>runtime</scope>
</dependency>
</dependencies>
</profile>

<!-- Include the Apache Flink runner with -P flink-runner -->
<profile>
<id>flink-runner</id>
Expand Down Expand Up @@ -329,6 +341,30 @@
</systemPropertyVariables>
</configuration>
</execution>
<execution>
<id>gearpump-runner-integration-tests</id>
<goals>
<goal>integration-test</goal>
<goal>verify</goal>
</goals>
<configuration>
<includes>
<include>WordCountIT.java</include>
<include>WindowedWordCountIT.java</include>
</includes>
<parallel>none</parallel>
<threadCount>4</threadCount>
<systemPropertyVariables>
<beamTestPipelineOptions>
[
"--project=apache-beam-testing",
"--tempRoot=gs://temp-storage-for-end-to-end-tests",
"--runner=org.apache.beam.runners.gearpump.TestGearpumpRunner"
]
</beamTestPipelineOptions>
</systemPropertyVariables>
</configuration>
</execution>
</executions>
</plugin>
</plugins>
Expand Down
6 changes: 6 additions & 0 deletions pom.xml
Expand Up @@ -572,6 +572,12 @@
<version>${project.version}</version>
</dependency>

<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-runners-gearpump</artifactId>
<version>${project.version}</version>
</dependency>

<dependency>
<groupId>org.apache.beam</groupId>
<artifactId>beam-examples-java</artifactId>
Expand Down
61 changes: 61 additions & 0 deletions runners/gearpump/README.md
@@ -0,0 +1,61 @@
<!--
Licensed to the Apache Software Foundation (ASF) under one
or more contributor license agreements. See the NOTICE file
distributed with this work for additional information
regarding copyright ownership. The ASF licenses this file
to you under the Apache License, Version 2.0 (the
"License"); you may not use this file except in compliance
with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing,
software distributed under the License is distributed on an
"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
KIND, either express or implied. See the License for the
specific language governing permissions and limitations
under the License.
-->

## Gearpump Beam Runner

The Gearpump Beam runner allows users to execute pipelines written using the Apache Beam programming API with Apache Gearpump (incubating) as an execution engine.

##Getting Started

The following shows how to run the WordCount example that is provided with the source code on Beam.

###Installing Beam

To get the latest version of Beam with Gearpump-Runner, first clone the Beam repository:

```
git clone https://github.com/apache/beam
git checkout gearpump-runner
```

Then switch to the newly created directory and run Maven to build the Apache Beam:

```
cd beam
mvn clean install -DskipTests
```

Now Apache Beam and the Gearpump Runner are installed in your local Maven repository.

###Running Wordcount Example

Download something to count:

```
curl http://www.gutenberg.org/cache/epub/1128/pg1128.txt > /tmp/kinglear.txt
```

Run the pipeline, using the Gearpump runner:

```
cd examples/java
mvn exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount -Dexec.args="--inputFile=/tmp/kinglear.txt --output=/tmp/wordcounts.txt --runner=TestGearpumpRunner" -Pgearpump-runner
```

Once completed, check the output file /tmp/wordcounts.txt-00000-of-00001