Spark Streaming WIP
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
data
project
reference
src/main
.gitignore
LICENSE
README.md
build.sbt

README.md

WIP

Update old Streaming examples to Spark 2 Add new ones too

Kinesis example

Run SparkKinesisExample with arguments; i.e

com.supergloo.kinesis.SparkKinesisExample KinesisApp wm https://kinesis.us-east-1.amazonaws.com

Run/Debug Configuration Screenshot from IntelliJ Example

alt text

Running via spark-submit example

spark-submit --class com.supergloo.kinesis.SparkKinesisExample ./target/scala-2.11/spark-2-streaming-assembly-1.0.jar KinesisApp wm https://kinesis.us-east-1.amazonaws.com

In DSE 5.1.3 and above spark-submit example

dse --framework spark-2.0 spark-submit --class com.supergloo.kinesis.SparkKinesisExample ./target/scala-2.11/spark-2-streaming-assembly-1.0.jar KinesisApp wm https://kinesis.us-east-1.amazonaws.com