References for building custom IDEs

Sample pyspark Notebook

PySpark complete tutorial

Code for "Efficient Data Processing in Spark" Course

Big Data: Spark Lab and ClickHouse Lab Solutions

📈📊 Big Data Notebooks . ▫️ Análisis masivos de datos con pyspark ▫️ Ingesta de datos. ▫️ Algoritmos de machine learning con datos masivos. ▫️ Procesamiento de mensajes en tiempo real con Kafka.

This repo is for the Structured Streaming and Projects

This repo is built to learn and practice databricks and PySpark. This is the practice repo for databricks Data Engineering Associate Certification

APACHE SPARK: Data Analysis, Transformation, and Visualisation with PySpark, IPL Data Analysis

spark247-jupyter-dockerized

AEMO Aggregated price and demand data

Tracking Tweet sentiment at scale using a pretrained Huggingface transformer (classifier) Model

A collection of useful google colab notebooks

This repository is a comprehensive collection of various datasets, each carefully curated to demonstrate and explore the power of Databricks in performing ETL (Extract, Transform, Load) processes.

Small code practices to generate a good dummy dataframes for PySpark Practices

Hadoop+PySpark大数据挖掘、处理与分析

Analises de Dados e machine learning com o Pyspark

Code for blog at: https://www.startdataengineering.com/post/docker-for-de/