Skip to content
BENIBIX Learn

Azure Data Factory (ADF)

Data🗓️ OrchestrationOrchestration Tools

Also known as ADF, Microsoft Azure Data Factory, Azure Data Factory Pipeline

A cloud tool from Microsoft. You drag boxes to copy data and run pipelines.

Think of it like

It is like a toy train set you build on the floor. You snap the tracks together, then press go.

Example

A shop copies its sales from its own SQL Server to Azure each night with ADF. A second step then starts a notebook in Databricks.

Why it matters

Many Microsoft shops use it as both their loader and their orchestrator. It is often the first data tool an Azure team meets.

Definition

Azure Data Factory is a cloud service from Microsoft that moves data and runs pipelines. You build a pipeline in a browser by dragging boxes and joining them. One kind of box copies data between more than 90 kinds of sources. Other boxes run code, call notebooks or wait. Triggers start pipelines on a schedule or when a file lands. You pay for each run and for the data moved.
In ADF, each box is an activity you drag onto a canvas. The arrows are drawn by hand, too.

Common mistake

Building hundreds of near copies of one pipeline by hand. Use settings you pass in, so one pipeline serves many tables.

Key takeaways

  1. 1
    Drag and drop. Pipelines are built from boxes.
  2. 2
    Copy plus control. It moves data and runs steps.
  3. 3
    Triggers. Start on a schedule or an event.