Name		Name	Last commit message	Last commit date
Latest commit History 3 Commits
Data-Factory		Data-Factory
Exp #3542 - Join		Exp #3542 - Join
Exp #3799 - Join-Filter		Exp #3799 - Join-Filter
Exp #5287 - Persist		Exp #5287 - Persist
Labs		Labs
WIP		WIP
_Archive		_Archive
Exp #0000-P - Exploring the Spark UI.py		Exp #0000-P - Exploring the Spark UI.py
Exp #0000-S - Exploring the Spark UI.scala		Exp #0000-S - Exploring the Spark UI.scala
Exp #1241-S - maxPartitionBytes.scala		Exp #1241-S - maxPartitionBytes.scala
Exp #1242-S - openCostInBytes.scala		Exp #1242-S - openCostInBytes.scala
Exp #1337-S - Z-Order Haystack Query.scala		Exp #1337-S - Z-Order Haystack Query.scala
Exp #1596-S - Skew Joins.scala		Exp #1596-S - Skew Joins.scala
Exp #2163-S - IO Cache.scala		Exp #2163-S - IO Cache.scala
Exp #2586-P - Manual Compaction.py		Exp #2586-P - Manual Compaction.py
Exp #2586-S - Manual Compaction.scala		Exp #2586-S - Manual Compaction.scala
Exp #2653-S - Shuffle Partitions.scala		Exp #2653-S - Shuffle Partitions.scala
Exp #2934-S - Predicate Pushdown Comparison.scala		Exp #2934-S - Predicate Pushdown Comparison.scala
Exp #2935-P - Predicate Pushdown.py		Exp #2935-P - Predicate Pushdown.py
Exp #4112-S - Columnar Reads.scala		Exp #4112-S - Columnar Reads.scala
Exp #4538-P - UDFs.py		Exp #4538-P - UDFs.py
Exp #4538-S - UDFs.scala		Exp #4538-S - UDFs.scala
Exp #5980-PS - Benchmarking.scala		Exp #5980-PS - Benchmarking.scala
Exp #6167-S - Bucket Join.scala		Exp #6167-S - Bucket Join.scala
Exp #6518-S - Spill.scala		Exp #6518-S - Spill.scala
Exp #6732-S - Producing Bucketed Datasets.scala		Exp #6732-S - Producing Bucketed Datasets.scala
Exp #8342-S - Predicate Pushdown.scala		Exp #8342-S - Predicate Pushdown.scala
Exp #8357-S - Tuning JDBC.scala		Exp #8357-S - Tuning JDBC.scala
Exp #8923-S - Read Tiny Files.scala		Exp #8923-S - Read Tiny Files.scala
Exp #8973-S - Scanning.scala		Exp #8973-S - Scanning.scala
Exp #9156-S - Hash Partitioning Skew-n-Spill.scala		Exp #9156-S - Hash Partitioning Skew-n-Spill.scala
README.md		README.md
_READ_ME.scala		_READ_ME.scala

Repository files navigation

Spark UI Simulator Experiments

This repo contains all the source notebooks for the various experiments.

For more information, please reach out to: Jacob D. Parr jacob.parr@databricks.com (non-preferred) slack (preferred)

BhuiyanMH/spark-ui-simulator-experiments

Folders and files

Latest commit

History

Repository files navigation

Spark UI Simulator Experiments

About

Resources

Stars

Watchers

Forks

Languages