[BEAM-845] Update Apex runner info after merge to master. #78

tweise · 2016-11-12T10:33:33Z

asfbot · 2016-11-12T10:35:28Z

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Website_Test/51/

asfbot · 2016-11-12T10:37:30Z

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Website_Stage/96/

Jenkins built the site at commit id 6cbdbde with Jekyll and staged it here. Happy reviewing.

Note that any previous site has been deleted. This staged site will be automatically deleted after its TTL expires. Push any commit to the pull request branch or re-trigger the build to get it staged again.

jbonofre · 2016-11-12T11:04:14Z

CC: @jbonofre

davorbonaci

Great! Just one minor comment to catch up with recent additions to the website ;-)

davorbonaci · 2016-11-13T18:33:06Z

src/documentation/runners/apex.md

@@ -5,5 +5,5 @@ permalink: /documentation/runners/apex/
 ---
 # Using the Apache Apex Runner

-This page is under construction ([BEAM-825](https://issues.apache.org/jira/browse/BEAM-825)). The runner is on a feature branch.
+This page is under construction ([BEAM-825](https://issues.apache.org/jira/browse/BEAM-825)).


FYI only -- see #76 and #77 for good examples on getting started on this. (Not for this PR.)

davorbonaci · 2016-11-13T18:35:15Z

src/index.md

@@ -9,7 +9,7 @@ The Apache Beam project is in the process of bootstrapping. This includes the we

 # Apache Beam (incubating)

-Apache Beam is an open source, unified programming model that you can use to create a data processing **pipeline**. You start by building a program that defines the pipeline using one of the open source Beam SDKs. The pipeline is then executed by one of Beam's supported **distributed processing back-ends**, which include [Apache Flink](http://flink.apache.org), [Apache Spark](http://spark.apache.org), and [Google Cloud Dataflow](https://cloud.google.com/dataflow).
+Apache Beam is an open source, unified programming model that you can use to create a data processing **pipeline**. You start by building a program that defines the pipeline using one of the open source Beam SDKs. The pipeline is then executed by one of Beam's supported **distributed processing back-ends**, which include [Apache Apex](http://apex.apache.org), [Apache Flink](http://flink.apache.org), [Apache Spark](http://spark.apache.org), and [Google Cloud Dataflow](https://cloud.google.com/dataflow).


Can you do the same for the new Quickstart page too?

asfbot · 2016-11-13T23:43:11Z

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Website_Test/56/

asfbot · 2016-11-13T23:43:58Z

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Website_Stage/100/

Jenkins built the site at commit id 565fdaf with Jekyll and staged it here. Happy reviewing.

Note that any previous site has been deleted. This staged site will be automatically deleted after its TTL expires. Push any commit to the pull request branch or re-trigger the build to get it staged again.

tweise · 2016-11-13T23:57:53Z

@davorbonaci done. Build error unrelated:

- ./content/subdir/beam/update/2016/10/11/strata-hadoop-world-and-beam.html
  *  External link https://www.oreilly.com/ideas/future-proof-and-scale-proof-your-code failed: got a time out (response code 0)
rake aborted

asfbot · 2016-11-14T00:03:31Z

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Website_Test/57/

asfbot · 2016-11-14T00:04:34Z

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Website_Stage/101/

Jenkins built the site at commit id 38c2a69 with Jekyll and staged it here. Happy reviewing.

Note that any previous site has been deleted. This staged site will be automatically deleted after its TTL expires. Push any commit to the pull request branch or re-trigger the build to get it staged again.

davorbonaci

LGTM, ready to merge.

Leaving a few optional comments if they make sense.

davorbonaci · 2016-11-14T00:02:48Z

src/get-started/quickstart.md

@@ -73,6 +73,12 @@ $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \
     -Dexec.args="--inputFile=pom.xml --output=counts"
 ```

+{:.runner-apex}
+``` 
+$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \


Could we teach the users here how to run on Apex locally and on a remote cluster?

Will add it later when the runner supports launch on YARN cluster - BEAM-830

davorbonaci · 2016-11-14T00:03:17Z

src/get-started/quickstart.md

@@ -100,6 +106,11 @@ Once the pipeline has completed, you can view the output. You'll notice that the
 $ ls counts*
 ```

+{:.runner-apex}


Is there some UI that users can see if running locally/remotely?

Not for embedded mode, we will add the instructions for YARN later.

davorbonaci · 2016-11-14T00:03:53Z

src/get-started/quickstart.md

@@ -56,7 +56,7 @@ For a detailed introduction to the Beam concepts used in these examples, see the

 ## Run WordCount

-A single Beam pipeline can run on multiple Beam [runners]({{ site.baseurl }}/documentation#runners), including the [SparkRunner]({{ site.baseurl }}/documentation/runners/spark), [FlinkRunner]({{ site.baseurl }}/documentation/runners/flink), or [DataflowRunner]({{ site.baseurl }}/documentation/runners/dataflow). The [DirectRunner]({{ site.baseurl }}/documentation/runners/direct) is a common runner for getting started, as it runs locally on your machine and requires no specific setup.
+A single Beam pipeline can run on multiple Beam [runners]({{ site.baseurl }}/documentation#runners), including the [SparkRunner]({{ site.baseurl }}/documentation/runners/spark), [FlinkRunner]({{ site.baseurl }}/documentation/runners/flink), [ApexRunner]({{ site.baseurl }}/documentation/runners/apex) or [DataflowRunner]({{ site.baseurl }}/documentation/runners/dataflow). The [DirectRunner]({{ site.baseurl }}/documentation/runners/direct) is a common runner for getting started, as it runs locally on your machine and requires no specific setup.


same order as elsewhere: Apex, Flink, Spark, Dataflow?

asfbot · 2016-11-14T00:16:00Z

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Website_Test/58/

asfbot · 2016-11-14T00:16:44Z

Refer to this link for build results (access rights to CI server needed):
https://builds.apache.org/job/beam_PreCommit_Website_Stage/102/

Jenkins built the site at commit id b372fd9 with Jekyll and staged it here. Happy reviewing.

Note that any previous site has been deleted. This staged site will be automatically deleted after its TTL expires. Push any commit to the pull request branch or re-trigger the build to get it staged again.

davorbonaci · 2016-11-14T00:18:28Z

Perfect. Merging.

davorbonaci requested changes Nov 13, 2016

View reviewed changes

tweise force-pushed the BEAM-845 branch from 6cbdbde to 565fdaf Compare November 13, 2016 23:40

tweise force-pushed the BEAM-845 branch from 565fdaf to 38c2a69 Compare November 14, 2016 00:00

davorbonaci approved these changes Nov 14, 2016

View reviewed changes

Update Apex runner info after merge to master.

b372fd9

tweise force-pushed the BEAM-845 branch from 38c2a69 to b372fd9 Compare November 14, 2016 00:12

asfgit merged commit b372fd9 into apache:asf-site Nov 14, 2016

asfgit pushed a commit that referenced this pull request Nov 14, 2016

This closes #78

2bd1944

robertwb pushed a commit to robertwb/incubator-beam that referenced this pull request Jun 5, 2018

This closes apache/beam-site#78

df51ab4

robertwb pushed a commit to robertwb/incubator-beam that referenced this pull request Jun 5, 2018

This closes apache/beam-site#78

f364c4c

melap pushed a commit to apache/beam that referenced this pull request Jun 20, 2018

This closes apache/beam-site#78

fd0642c

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[BEAM-845] Update Apex runner info after merge to master. #78

[BEAM-845] Update Apex runner info after merge to master. #78

tweise commented Nov 12, 2016

asfbot commented Nov 12, 2016

asfbot commented Nov 12, 2016

jbonofre commented Nov 12, 2016

davorbonaci left a comment

davorbonaci Nov 13, 2016

davorbonaci Nov 13, 2016

asfbot commented Nov 13, 2016

asfbot commented Nov 13, 2016

tweise commented Nov 13, 2016

asfbot commented Nov 14, 2016

asfbot commented Nov 14, 2016

davorbonaci left a comment

davorbonaci Nov 14, 2016

tweise Nov 14, 2016

davorbonaci Nov 14, 2016

tweise Nov 14, 2016

davorbonaci Nov 14, 2016

tweise Nov 14, 2016

asfbot commented Nov 14, 2016

asfbot commented Nov 14, 2016

davorbonaci commented Nov 14, 2016

[BEAM-845] Update Apex runner info after merge to master. #78

[BEAM-845] Update Apex runner info after merge to master. #78

Conversation

tweise commented Nov 12, 2016

asfbot commented Nov 12, 2016

asfbot commented Nov 12, 2016

jbonofre commented Nov 12, 2016

davorbonaci left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

asfbot commented Nov 13, 2016

asfbot commented Nov 13, 2016

tweise commented Nov 13, 2016

asfbot commented Nov 14, 2016

asfbot commented Nov 14, 2016

davorbonaci left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

asfbot commented Nov 14, 2016

asfbot commented Nov 14, 2016

davorbonaci commented Nov 14, 2016