Medallion Architecture

Databricks is Medallion architecture

• Neither Kappa nor Lambda architecture
• 化流为微批，与Kappa思想完全相反
• aka. Delta architecture. Thus it relies on Delta Lake concept

Medallion Architecture

A data design pattern used to logically organize data in a lakehouse

• incrementally and progressively improving the structure and quality of data
• it flows through each layer of the architecture (from Bronze ⇒ Silver ⇒ Gold layer tables)
• Coined by Databricks

compatible with the concept of a data mesh

• Bronze and silver tables can be joined together in a "one-to-many" fashion
• the data in a single upstream table("one") could be used to generate multiple downstream tables ("many").

Ref

• https://dataengineering.wiki/Concepts/Medallion+Architecture