Master repository for both scala compiler plugin and broadcast join, includes report
HTML
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
benchmarks @ 9e37f4d
broadcast-join @ 623cc34 Update submodules Dec 7, 2017
plugin-benchmark @ d3038fb
scala-plugin @ 89c4003 update scala-plugin head Dec 7, 2017
.gitignore Add report Dec 7, 2017
.gitmodules Add benchmarks submodule as well Dec 7, 2017
Makefile Adding make report Dec 7, 2017
README.md Update README.md Dec 7, 2017
Report.Rmd Fix units in figure Dec 8, 2017
Report.html Update submodules Dec 7, 2017
Report.pdf Fix units in figure Dec 8, 2017

README.md

Join Optimizations

This repository is the master repository for all the different repositories used for this project.

Cloning

To clone all the submodules included in this project, clone this repository with the following command:

git clone --recursive https://github.com/spark-optimizations/join-optimizations.git

To generate the report use the following command:

make report

Here's the summary of all the submodule repositories. To know more about these submodules, please read their README files:

  • Scala compiler plugin

    • This repository contains code for building scala compiler plugin used to optimize spark joins using column pruning.
  • Broadcast Join

    • This repository contains implementation of broadcast join on spark RDDs
  • Plugin Benchmarks

    • This repository contains benchmarking code for scala compiler plugin
  • Broadcast Join Benchmarks

    • This repository contains benchmarking code for broadcast join

Authors