Databricks framework to validate Data Quality of pySpark DataFrames and Tables
Databricks-native data trust pipeline — intake certification, drift gating, and control benchmarking in a single deployable product.
Demo of Databricks Lakeflow Jobs Automation with StackQL and Databricks Asset Bundles
A Databricks control pattern that certifies every record before downstream consumption. 7 contract checks, replay detection, schema drift handling, and quarantine with explicit reasons. 56 passing tests. Databricks Free Edition validated. Enterprise Data Trust, Chapter 1.
Metadata-driven pipeline orchestration pattern on Databricks — dynamic DAG from a Delta control table, Jobs API v2.2, Unity Catalog, Lakeflow. Deployable via Databricks Asset Bundle.
Add a description, image, and links to the lakeflow topic page so that developers can more easily learn about it.
To associate your repository with the lakeflow topic, visit your repo's landing page and select "manage topics."