No description, website, or topics provided.
Scala
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
project
src minor tweaks Oct 19, 2014
README.md
build.sbt

README.md

Spark Testing Example Application

Source code for blog posts:

Testing

By default tests are running with Spark in local mode

sbt test

If you want to run tests in standalone Spark cluster you need to provide spark.master url

sbt -Dspark.master=spark://spark-host:7777 test-assembled

Building

In the root directory run:

sbt assembly

The application fat jars will be placed in:

  • target/scala-2.10/spark-testing-example-app.jar

Running

First you need to run assembly in sbt and then run java cmd

java -Dspark.master=spark://spark-host:7777 spark-testing-example-app.jar