# Fan-Out and Fan-In

> One task splits into many that run at once. Then one task waits for them all.

**Field:** Data Engineering  
**Category:** Orchestration  
**Also known as:** Fan-Out, Fan-In, Fan-Out/Fan-In, Parallel Tasks

## Think of it like

It is like one teacher handing out three worksheets. Three pupils work at once, then hand them all back.

## Definition

Fan-out is when one task starts many tasks that run at the same time. Fan-in is when one task waits for all of them to finish. Together they split a big job into parts and join the results. The parts must not depend on each other, or they cannot run at once. A pipeline that loads each region in its own task is a common case.

## Example

A pipeline loads Europe, Asia and the Americas as three tasks at once. The report task waits for all three. The run takes 20 minutes instead of an hour.

## Why it matters

Running parts side by side cuts the wait. It also means one slow region does not hold up the others.

## Common mistake

Fanning out to hundreds of tasks at once. The database they all hit can slow down or fall over.

## Three principles

- **Split.** One task starts many.
- **Run at once.** Parts must not need each other.
- **Join.** One task waits for all of them.

## Related terms

- [Task Dependency](https://learn.benibix.com/term/data/task-dependency)
- [Airflow Task Group](https://learn.benibix.com/term/data/airflow-task-group)
- [Workflow Orchestration](https://learn.benibix.com/term/data/workflow-orchestration)
- [Airflow Executor](https://learn.benibix.com/term/data/airflow-executor)
- [AWS Step Functions](https://learn.benibix.com/term/data/aws-step-functions)

![A task called list regions splits into three highlighted tasks, load Europe, load Asia and load Americas, inside a dashed box named task group load_regions. All three lead into one task, build report, which waits for all 3. Labels below read fan-out and fan-in.](https://learn.benibix.com/diagrams/dat2-fan-out-in.svg)

---

Source: https://learn.benibix.com/term/data/fan-out-fan-in
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
