A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Python script that will update S3 file paths in Iceberg metadata files (metadata.json + AVRO)

Example using the Iceberg register_table command with AWS Glue and Glue Data Catalog

PySpark code samples designed for AWS Glue

Python library designed to enhance the developer experience when working with AWS Glue ETL and Python Shell jobs by reducing boilerplate code, increasing type safety, and improving IDE auto-completion.

An end-to-end data pipeline for De Ftunes’ music purchase analytics, designed to ingest, transform, and model data for efficient analysis of song purchases, user behavior, and service trends. Utilizes AWS Glue, S3, Redshift Spectrum, Apache Airflow, DBT, Superset, and Terraform.

Use the AWS Glue Schema Registry in Python projects.

A curated collection of streamlined and effective scripts and tools designed specifically for data engineering tasks.

Process DynamoDB change streams via. AWS Glue w Iceberg to keep a copy of a collection in S3 upto date

Stream CDC into an Amazon S3 data lake in Apache Iceberg table format with AWS Glue Streaming and DMS

Apache Hudi examples designed to be run on AWS Glue via. Glue Jobs

Heuristics for detecting outlier and non-arms-length sales

ETL pipeline using AWS services

Streaming ETL job cases in AWS Glue to integrate Delta Lake and creating an in-place updatable data lake on Amazon S3

Streaming ETL job cases in AWS Glue to integrate Iceberg and creating an in-place updatable data lake on Amazon S3

ETL pipeline using AWS services.

An end-to-end data engineering project in which five NYC DOT datasets were modified in an ETL process and analyzed for insights.

AWS Glue ETL transformation of tekken subreddit data

Cloud-based AI / ML workflow and data application development framework