SPARK-3639 | Removed settings master in examples #2536
Conversation
This patch removes setting of master as local in Kinesis examples so that users can set it using submit-job.
|
Can one of the admins verify this patch? |
| /* Setup the and SparkConfig and StreamingContext */ | ||
| /* Spark Streaming batch interval */ | ||
| val batchInterval = Milliseconds(2000) | ||
|
|
There was a problem hiding this comment.
Can you remove random new lines here?
|
ok to test. If tests pass this LGTM. |
|
QA tests have started for PR 2536 at commit
|
|
QA tests have finished for PR 2536 at commit
|
|
Test PASSed. |
This patch removes setting of master as local in Kinesis examples so that users can set it using submit-job.
…nto Kinesis-Examples-Master-Unset Conflicts: extras/kinesis-asl/src/main/java/org/apache/spark/examples/streaming/JavaKinesisWordCountASL.java extras/kinesis-asl/src/main/scala/org/apache/spark/examples/streaming/KinesisWordCountASL.scala
|
QA tests have started for PR 2536 at commit
|
|
@andrewor14 thanks for reviewing this. All review comments have been incorporated. Please review once again. |
|
QA tests have finished for PR 2536 at commit
|
|
Test PASSed. |
|
Ok I'm merging this into master and 1.1. Thanks. |
This patch removes setting of master as local in Kinesis examples so that users can set it using submit-job. Author: aniketbhatnagar <aniket.bhatnagar@gmail.com> Closes #2536 from aniketbhatnagar/Kinesis-Examples-Master-Unset and squashes the following commits: c9723ac [aniketbhatnagar] Merge remote-tracking branch 'origin/Kinesis-Examples-Master-Unset' into Kinesis-Examples-Master-Unset fec8ead [aniketbhatnagar] SPARK-3639 | Removed settings master in examples 31cdc59 [aniketbhatnagar] SPARK-3639 | Removed settings master in examples (cherry picked from commit d16e161) Signed-off-by: Andrew Or <andrewor14@gmail.com>
This patch removes setting of master as local in Kinesis examples so that users can set it using submit-job.