🧰Lakeflow Jobs
Also known as Databricks Jobs, Databricks Workflows, Databricks Job
A Databricks tool that runs your steps in order, at set times.
Think of it like
It is like a to-do list that does itself. Each task starts when the one before it is done.
Example
Every night at 2 AM, a job runs three tasks. It loads new files, then a pipeline cleans them, then a notebook updates a report table.
Why it matters
Work that runs only when someone clicks run is not a pipeline yet. A job makes it run on its own, every day.
Definition
Common mistake
Key takeaways
- 1Tasks. Notebooks, pipelines and scripts.
- 2Order. A task waits for the ones before it.
- 3Triggers. A set time, or new files landing.