Skip to content
Configuring a Spark application with Typesafe config (example application)
Scala
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
project
src/main First commit Jan 7, 2019
README.md
build.sbt First commit Jan 7, 2019
document.txt First commit Jan 7, 2019
wordcount.conf First commit Jan 7, 2019

README.md

Configuring a Spark application with Typesafe config (example application)

Example code for my blog post "Configuring Spark application with Typesafe config".

Basic instructions

Build assembly JAR:

sbt assembly

Run (local mode):

spark-submit --master local[*] --class xyz.florentforest.sparkconfigexample.ConfigWordCount --files wordcount.conf --driver-java-options -Dconfig.file=wordcount.conf sparkconfigexample-assembly-1.0.jar 
You can’t perform that action at this time.