jobs

Lakeflow Jobs

Job

• A Databricks job allows you to configure tasks to run in a specified compute environment on a specified schedule.

Schedule

在幕后，Databricks调度不过是一个用户界面，它基于出色而古老的Cron ---- 《Beginning Apache Spark Using Azure Databricks》

Task

A unit of logic(最小业务逻辑单元) in a job.

A task can be

• A notebook
• A JAR
• A SQL query
• A DLT pipeline
• Another job: choreography
• Control flow tasks: ochestrate
  • job control flow

It does not mean notebook is only a type of task. It means job task can refer to an existing notebook