Master repository for both scala compiler plugin and broadcast join, includes report
Switch branches/tags
Nothing to show
Clone or download

README.md

Join Optimizations

This repository is the master repository for all the different repositories used for this project.

Cloning

To clone all the submodules included in this project, clone this repository with the following command:

git clone --recursive https://github.com/spark-optimizations/join-optimizations.git

To generate the report use the following command:

make report

Here's the summary of all the submodule repositories. To know more about these submodules, please read their README files:

  • Scala compiler plugin

    • This repository contains code for building scala compiler plugin used to optimize spark joins using column pruning.
  • Broadcast Join

    • This repository contains implementation of broadcast join on spark RDDs
  • Plugin Benchmarks

    • This repository contains benchmarking code for scala compiler plugin
  • Broadcast Join Benchmarks

    • This repository contains benchmarking code for broadcast join

Authors