spark-ts-examples

Description

Examples showing how to use the spark-ts time series library for Apache Spark.

Minimum Requirements

• Java 1.8
• Maven 3.0
• Apache Spark 1.6.0

Using this Repo

Building

We use Maven for building Java / Scala. To compile and build the example jar, navigate to the jvm directory and run:

mvn package

Running

To submit one of the Java or Scala examples to a local Spark cluster, run the following command from the jvm directory:

spark-submit --class com.cloudera.tsexamples.Stocks target/spark-ts-examples-0.0.1-SNAPSHOT-jar-with-dependencies.jar

You can substitute any of the Scala or Java example classes as the value for the --class parameter.

To submit a Python example, run the following command from the python directory:

spark-submit --driver-class-path PATH/TO/sparkts-0.3.0-jar-with-dependencies.jar Stocks.py

The --driver-class-path parameter value must point to the Spark-TS JAR file, which can be downloaded from the spark-timeseries Github repo.