Benchmark Suite for Apache Spark
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github
bin
cli
conf
docs
examples
project
spark-launch
test-workloads/src/main/scala/com/ibm/sparktc/sparkbench/workload/custom
travis-shell-scripts
utils
.gitignore
.travis.yml
LICENSE
NOTICE
SparkBench_APC2015.pdf
build.sbt
readme.md
scalastyle-config.xml
version.sbt

readme.md

spark-bench

Benchmark Suite for Apache Spark

GitHub issues Build Status codecov

READ OUR DOCS

The documentation for Spark-Bench is all in our shiny new docs site: https://codait.github.io/spark-bench/

Versions And Compatibility

Spark Version

Spark-Bench is currently compiled against the Spark 2.1.1 jars and should work with Spark 2.x. If you experience compatibility issues between Spark-Bench and any 2.x version of Spark, please let us know!

Scala Version

Spark-Bench is written using Scala 2.11.8. It is incompatible with Spark versions running Scala 2.10.x

Installation

Follow the Quickstart guide from our docs site. For more details, see the Installation page.

Legacy Version

spark-bench has recently gone through an extensive rewrite. While we think you'll like the new capabilities, it is not quite feature complete with the previous version of spark-bench. Many of the workloads that were available in the legacy have not yet been ported over, but they will be!

In the meantime, if you would like to see the old version of spark-bench, it's preserved in the legacy branch.

You can also grab the last official release of the legacy version from here.