Azure Databricks Lakeflow (Spark Declarative Pipelines) + Unity Catalog Governance — Labs (v4)

This repo packages a 1‑day hands-on training with optional advanced modules.

Core labs

• Unity Catalog governance (storage credential, external location, grants)
• Medallion pattern (Bronze → Silver → Gold)
• Data quality expectations

Advanced labs (added)

• Materialized views + expectations + pipeline aggregations
• CDC using AUTO CDC APIs (SCD Type 1 and SCD Type 2)
• Incremental ingestion with Auto Loader (cloudFiles)

Placeholders

Replace:

• <storage-account> in pipeline code
• <credential_name> in governance SQL
• /Repos/<your-repo-path>/... in pipeline JSON templates