Popular repositories Loading

1. dist-keras dist-keras Public archive

   Distributed Deep Learning, with a focus on distributed training, using Keras and Apache Spark.

   Python 622 167

2. spark-dashboard spark-dashboard Public

   Spark-Dashboard is a solution for monitoring Apache Spark jobs. This repository provides the tooling and configuration for deploying an Apache Spark Performance Dashboard using containers technology.

   Dockerfile 120 21

3. SparkPlugins SparkPlugins Public

   Code and examples of how to write and deploy Apache Spark Plugins. Spark plugins allow runnig custom code on the executors as they are initialized. This also allows extending the Spark metrics syst…

   Scala 88 15

4. hdfs-metadata hdfs-metadata Public

   Tool for gathering blocks and replicas meta data from HDFS. It also builds a heat map showing how replicas are distributed along disks and nodes.

   Java 56 19

5. grafana-mimir-cardinality-dashboards grafana-mimir-cardinality-dashboards Public

   Grafana Mimir dashboards used for cardinality exploration

   40 7

6. SparkDLTrigger SparkDLTrigger Public

   Code and links to the data for the article "Machine Learning Pipelines with Modern Big DataTools for High Energy Physics"

   Jupyter Notebook 29 14