From 65a34c71e59ed66f8d667b89ef6f8ff56dcb5b09 Mon Sep 17 00:00:00 2001 From: rmishra Date: Sun, 6 Mar 2016 16:25:21 +0530 Subject: [PATCH 1/3] Doc Issue : Apache Spark Streaming guide elaborates UpdateStateByKey Operation and goes onto give an example. However for complete code sample it referes to {{site.SPARK_GITHUB_URL}}/blob/master/examples/src/main/scala/org/apache /spark/examples/streaming/StatefulNetworkWordCount.scala). StatefulNetworkWordCount.scala has changed to demonstrate more recent API mapWithState. This creates confusion in the document. Till the time more detailed explanation of mapWIthState is added the reference to StatefulNetworkWordCount.scala should be removed. --- docs/streaming-programming-guide.md | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index 677f5ff7bea8b..449db5e2c0c39 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -872,10 +872,7 @@ val runningCounts = pairs.updateStateByKey[Int](updateFunction _) {% endhighlight %} The update function will be called for each word, with `newValues` having a sequence of 1's (from -the `(word, 1)` pairs) and the `runningCount` having the previous count. For the complete -Scala code, take a look at the example -[StatefulNetworkWordCount.scala]({{site.SPARK_GITHUB_URL}}/blob/master/examples/src/main/scala/org/apache -/spark/examples/streaming/StatefulNetworkWordCount.scala). +the `(word, 1)` pairs) and the `runningCount` having the previous count.
From 40a40ed5e3540cd528d2cf7c555243c2b1e6a6d7 Mon Sep 17 00:00:00 2001 From: rmishra Date: Sun, 6 Mar 2016 16:35:52 +0530 Subject: [PATCH 2/3] Revert "Doc Issue : Apache Spark Streaming guide elaborates UpdateStateByKey Operation and goes onto give an example. However for complete code sample it referes to {{site.SPARK_GITHUB_URL}}/blob/master/examples/src/main/scala/org/apache" This reverts commit 65a34c71e59ed66f8d667b89ef6f8ff56dcb5b09. --- docs/streaming-programming-guide.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index 449db5e2c0c39..677f5ff7bea8b 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -872,7 +872,10 @@ val runningCounts = pairs.updateStateByKey[Int](updateFunction _) {% endhighlight %} The update function will be called for each word, with `newValues` having a sequence of 1's (from -the `(word, 1)` pairs) and the `runningCount` having the previous count. +the `(word, 1)` pairs) and the `runningCount` having the previous count. For the complete +Scala code, take a look at the example +[StatefulNetworkWordCount.scala]({{site.SPARK_GITHUB_URL}}/blob/master/examples/src/main/scala/org/apache +/spark/examples/streaming/StatefulNetworkWordCount.scala).
From 4a847ff23ed10a649e39f745ccb8003160216b12 Mon Sep 17 00:00:00 2001 From: rmishra Date: Sun, 6 Mar 2016 16:47:50 +0530 Subject: [PATCH 3/3] Doc Issue : Apache Spark Streaming guide elaborates UpdateStateByKey Operation and goes onto give an example. However for complete code sample it referes to {{site.SPARK_GITHUB_URL}}/blob/master/examples/src/main/scala/org/apache /spark/examples/streaming/StatefulNetworkWordCount.scala). StatefulNetworkWordCount.scala has changed to demonstrate more recent API mapWithState. This creates confusion in the document. Till the time more detailed explanation of mapWIthState is added the reference to StatefulNetworkWordCount.scala should be removed. --- docs/streaming-programming-guide.md | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-) diff --git a/docs/streaming-programming-guide.md b/docs/streaming-programming-guide.md index 677f5ff7bea8b..449db5e2c0c39 100644 --- a/docs/streaming-programming-guide.md +++ b/docs/streaming-programming-guide.md @@ -872,10 +872,7 @@ val runningCounts = pairs.updateStateByKey[Int](updateFunction _) {% endhighlight %} The update function will be called for each word, with `newValues` having a sequence of 1's (from -the `(word, 1)` pairs) and the `runningCount` having the previous count. For the complete -Scala code, take a look at the example -[StatefulNetworkWordCount.scala]({{site.SPARK_GITHUB_URL}}/blob/master/examples/src/main/scala/org/apache -/spark/examples/streaming/StatefulNetworkWordCount.scala). +the `(word, 1)` pairs) and the `runningCount` having the previous count.