Skip to content

ogre0403/NCHC-Spark-Tutorial

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

25 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Spark-sample

  1. Download VM lab environment using vagrant
    vagrant up {spark-master|spark-slave}
  1. Use sbt to build and run scala example
    sbt clean package
    $SPARK_HOME/bin/spark-submit \
      --class org.nchc.spark.scala.HelloWorld \
      ./target/scala-2.10/spark-sample_2.10-0.0.1.jar \
      ./README.md
  1. Use Maven to build and run Java example
	mvn clean; mvn compile; mvn package
    $SPARK_HOME/bin/spark-submit \
    --class org.nchc.spark.java.first.HelloWorld \
      ./target/spark-sample-0.0.1.jar \
      ./README.md
    $SPARK_HOME/bin/spark-submit \
      --class org.nchc.spark.java.first.HelloWorldLambda \
      ./target/spark-sample-0.0.1.jar \
      ./README.md
  1. Run Python example
    $SPARK_HOME/bin/spark-submit \
    ./python/HwlloWorld.py \
    ./README.md

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published