Orchestrate your Databricks notebooks in Airflow and execute them as Databricks Workflows

Deltalake examples designed to be run on AWS Elastic Map Reduce (EMR) via. EMR Studio or EMR Notebooks

Notebooks to learn Databricks Lakehouse Platform

Black for Databricks notebooks

This project contains the lab notebooks from course: Large Language Models: Foundation Models from the Ground Up

This project contains the lab notebooks from course: Large Language Models: Application through Production by Databricks

Testing framework for Databricks notebooks

machine learning for genomic variants

Keep your local python scripts installed and in sync with a databricks notebook. Shortens the feedback loop to develop projects using a hybrid environment.

This series of notebooks shows how the Lakehouse for Financial Services enables banks, open banking aggregators and payment processors to address the challenge of merchant classification

In this series of notebooks centered around geospatial analytics, we demonstrate how Lakehouse enables organizations to better understand customers behaviours, no longer based on who they are, but how they bank, no longer using a one-size-fits-all rule but a truly personalized AI

List of my data engineering projects

Examples of DataBricks notebooks

Databricks notebook, using Spark-Redis integration and RediSearch

🧱 A collection of supplementary utilities and helper notebooks to perform admin tasks on Databricks

dtflw is a Python framework for building modular data pipelines based on Databricks dbutils.notebook API.

Build a movie recommendation data pipeline using Azure services for efficient data ingestion, transformation, and orchestration. Utilize Azure Blob Storage, Azure Databricks, and Azure Data Factory to implement collaborative filtering and PySpark ML for accurate movie recommendations.

This project contains the lab notebooks and presentation from the Data AI Summit 2023 on-site training.

Series of notebooks that introduce Spark for Financial & Customer Data.

Sample notebooks on Azure Databricks for ETL