# Dropout

> Random neurons switch off in training. The rest learn to cope.

**Field:** Artificial Intelligence  
**Category:** Machine Learning  
**Also known as:** Dropout Regularization

## Think of it like

Think of it like a team where some players sit out each game. Then all of them learn every job.

## Definition

Dropout switches off random neurons during training so a network cannot memorise. At each step, some neurons, often 10 to 50 percent, are turned off at random. The rest have to do the job without them. This stops the network from leaning too hard on any one neuron. When the model is used for real, all neurons are switched back on.

## Example

Jack adds dropout of 0.3 to his network. At each step, 3 in 10 neurons sit out. His validation score goes up by 5 points.

## Why it matters

It is cheap, simple and works on many networks. It was a big step in making deep networks practical.

## Common mistake

Leaving dropout on when the model is used for real. It should only be on during training.

## Three principles

- **Switch off at random.** Some neurons sit out.
- **Spread the work.** No neuron is leaned on too hard.
- **Training only.** All neurons back on in use.

## Related terms

- [Regularization](https://learn.benibix.com/term/ai/regularization)
- [Overfitting](https://learn.benibix.com/term/ai/overfitting)
- [Artificial Neuron](https://learn.benibix.com/term/ai/artificial-neuron)
- [Neural Network](https://learn.benibix.com/term/ai/neural-network)

## Taught in

- [Regularization and Dropout](https://learn.benibix.com/learn/ai-machine-learning/regularization-and-dropout): Machine Learning, 17/18

![The same network twice. On the left, all neurons are on. On the right, during one training step, some neurons are crossed out and their links are gone.](https://learn.benibix.com/diagrams/nn-dropout.svg)

---

Source: https://learn.benibix.com/term/ai/dropout
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
