notebooks

AWS Glue Notebook Samples

This repository has sample iPython notebook files which show you how to use open data dake formats; Apache Hudi, Delta Lake, and Apache Iceberg on AWS Glue Interactive Sessions and AWS Glue Studio Notebook.

Native connector based Examples

Following examples are based on native connectors.

Apache Hudi

• Hudi DataFrame example
• Hudi Spark SQL example
• Hudi to Redshift incremental load

Delta Lake

• Delta Lake DataFrame example
• Delta Lake Spark SQL example
• Delta Lake Spark SQL example using S3 path
• Delta to Snowflake incremental load

Apache Iceberg

• Iceberg DataFrame example
• Iceberg Spark SQL example

Custom/Marketplace connector based Examples

Following examples are based on custom/marketplace connectors. See details in Process Apache Hudi, Delta Lake, Apache Iceberg datasets at scale, part 1: AWS Glue Studio Notebook.

Apache Hudi

• Hudi DataFrame example
• Hudi Spark SQL example

Delta Lake

• Delta Lake DataFrame example
• Delta Lake Spark SQL example
• Delta Lake Spark SQL example using S3 path

Apache Iceberg

• Iceberg DataFrame example
• Iceberg Spark SQL example