#

Apache Spark

Apache Spark is an open source distributed general-purpose cluster-computing framework. It provides an interface for programming entire clusters with implicit data parallelism and fault tolerance.

Here are 316 public repositories matching this topic...

HariSekhon / Dockerfiles

50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak

Updated Feb 23, 2024
Shell

collabH / bigdata-growth

大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

kafka spark hive hadoop bigdata kudu hbase olap hdfs mapreduce flink debezium bigdatalearning hudi

Updated May 15, 2024
Shell

zhonghuasheng / Tutorial

后端（Java Golang）全栈知识架构体系总结

mysql java go redis mqtt tutorial spark spring mongodb netty tomcat keepalived springboot rocketmq springcloud emsp

Updated Mar 27, 2024
Shell

ruoyu-chen / hadoop-docker

基于Docker构建的Hadoop开发测试环境，包含Hadoop，Hive，HBase，Spark

spark hive centos hadoop-docker docker-hadoop

Updated May 26, 2019
Shell

radanalyticsio / openshift-spark

docker spark openshift

Updated Nov 17, 2021
Shell

testdrivenio / spark-kubernetes

spark on kubernetes

docker kubernetes spark

Updated Feb 20, 2023
Shell

miguno / wirbelsturm

[PROJECT IS NO LONGER MAINTAINED] Wirbelsturm is a Vagrant and Puppet based tool to perform 1-click local and remote deployments, with a focus on big data tech like Kafka.

vagrant puppet kafka spark apache-spark storm apache-storm apache-kafka

Updated Feb 21, 2022
Shell

martinprobson / vagrant-hadoop-hive-spark

Vagrant project to spin up a single node VM running current versions of Hadoop, Hive and Spark

training vagrant spark hive hadoop sandbox

Updated Feb 15, 2022
Shell

JahstreetOrg / spark-on-kubernetes-docker

Spark on Kubernetes infrastructure Docker images repo

docker kubernetes spark jupyter livy history-server

Updated Oct 20, 2022
Shell

Segence / docker-hadoop

A Docker container with a full Hadoop cluster setup with Spark and Zeppelin

docker spark hadoop hadoop-cluster zeppelin-notebook

Updated Feb 2, 2020
Shell

rubenafo / docker-spark-cluster

A Spark cluster setup running on Docker containers

docker scala big-data spark hadoop docker-image openjdk

Updated Dec 26, 2019
Shell

PierreKieffer / docker-spark-yarn-cluster

Docker multi-nodes Hadoop cluster with Spark 2.4.1 on Yarn

docker spark yarn hadoop cluster yarn-hadoop-cluster

Updated Dec 7, 2020
Shell

iamabug / BigDataParty

大数据组件 All-in-One 的 Dockerfile

dockerfile kafka big-data spark hadoop

Updated Feb 1, 2021
Shell

bambrow / docker-hadoop-workbench

A Hadoop cluster based on Docker, including Hive and Spark.

docker big-data spark hive hadoop docker-compose

Updated Nov 13, 2022
Shell

radanalyticsio / oshinko-s2i

This is a place to put s2i images and utilities for spark application builders for openshift

java scala spark openshift pyspark s2i-image oshinko-s2i

Updated Apr 28, 2021
Shell

dimajix / docker-jupyter-spark

Docker image for Jupyter notebooks with PySpark

python docker spark hadoop jupyter pyspark

Updated Aug 3, 2018
Shell

apache / spark-docker

Official Dockerfile for Apache Spark

python java r scala sql big-data spark jdbc

Updated Apr 4, 2024
Shell

damaohongtu / full-bigdata-docker

docker搭建大数据平台(我的第一本书)

mysql docker kafka spark yarn hive hadoop bigdata hbase zookeeper flume

Updated Mar 25, 2019
Shell

naushadh / hive-metastore

Apache Hive Metastore as a Standalone server in Docker

docker spark presto trino hive-metastore localstack

Updated Feb 29, 2024
Shell

felixcheung / vagrant-projects

Vagrant projects for various use-cases with Spark, Zeppelin, IPython / Jupyter, SparkR

python vagrant r spark cassandra jupyter ipython zeppelin

Updated May 13, 2016
Shell

Created by Matei Zaharia

Released May 26, 2014

Followers: 416 followers
Repository: apache/spark
Website: spark.apache.org
Wikipedia: Wikipedia

Related Topics