Installation

Add this line to your application's Gemfile:

gem 'ruby-spark'

And then execute:

$ bundle

Or install it yourself as:

$ gem install ruby-spark

Install Apache Spark

To install latest supported Spark. Project is build by SBT.

$ ruby-spark build

More options (default versions here).

$ ruby-spark build --hadoop-version HADOOP_VERSION \
                   --spark-home TARGET_DIRECTORY \
                   --spark-core CORE_VERSION \
                   --spark-version SPARK_VERSION \
                   --scala-version SCALA_VERSION