Skip to content

spark-optimizations/join-optimizations

Repository files navigation

Join Optimizations

This repository is the master repository for all the different repositories used for this project.

Cloning

To clone all the submodules included in this project, clone this repository with the following command:

git clone --recursive https://github.com/spark-optimizations/join-optimizations.git

To generate the report use the following command:

make report

Here's the summary of all the submodule repositories. To know more about these submodules, please read their README files:

  • Scala compiler plugin

    • This repository contains code for building scala compiler plugin used to optimize spark joins using column pruning.
  • Broadcast Join

    • This repository contains implementation of broadcast join on spark RDDs
  • Plugin Benchmarks

    • This repository contains benchmarking code for scala compiler plugin
  • Broadcast Join Benchmarks

    • This repository contains benchmarking code for broadcast join

Authors

About

Master repository for both scala compiler plugin and broadcast join, includes report

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages