Run your first analysis project on Apache Zeppelin using Scala (Spark), Shell, and SQL

The project harnessed an ETL multi-hop architecture, ingesting data from the Ergast API into a storage backed by Azure Data Lake. The process involved weekly ingestion of bronze layer data as cutover and delta files. Raw data, in varied formats, was transformed using Azure Databricks PySpark notebooks into enriched Silver and Gold layers.

The University of California, San Diego, course DSE230x "Big Data Analytics Using Spark" (Summer 2019): Learn how to analyze large datasets using Jupyter notebooks, MapReduce and Spark as a platform. Part 4 of the »Data Science« MicroMasters® Program on edX. Instructor: Yoav Freund, Professor of CS and Engineering, University of California San D…

Soccer Tweet Analysis using SprakSQL on a Jupyter notebook

Jupyter Notebook showing how to process Telecom datasets using PySpark (SparkSQL and DataFrames) and plotting the results using Matplotlib.

A JupyterLab extension providing, SQL formatter, auto-completion, syntax highlighting, Spark SQL and Trino