# Ensemble Learning

> Many models each make a guess. Joined up, they beat most single models.

**Field:** Artificial Intelligence  
**Category:** Machine Learning  
**Also known as:** Ensemble Method, Model Ensemble, Bagging and Boosting

## Think of it like

It is like asking a crowd to guess the sweets in a jar. The average guess beats most single guesses.

## Definition

Ensemble learning combines many models into one stronger one. Each model makes its own guess, and the guesses are joined. In bagging, many models train on random slices of data and then vote. A random forest works this way. In boosting, models train one after another, each fixing the last one's mistakes. Gradient boosting works this way.

## Example

Emma trains 200 small trees on random parts of her data. Each one guesses a house price, and the average is her final answer.

## Why it matters

Joined models win many contests on table data. Their mistakes tend to cancel out.

## Common mistake

Combining models that all make the same mistakes. An ensemble helps only when its models differ.

## Three principles

- **Many models.** Each one makes its own guess.
- **Bagging votes.** Models train side by side.
- **Boosting fixes.** Each model fixes the last one.

## Related terms

- [Random Forest](https://learn.benibix.com/term/ai/random-forest)
- [Gradient Boosting](https://learn.benibix.com/term/ai/gradient-boosting)
- [Decision Tree](https://learn.benibix.com/term/ai/decision-tree)
- [XGBoost](https://learn.benibix.com/term/ai/xgboost)
- [Bias-Variance Tradeoff](https://learn.benibix.com/term/ai/bias-variance-tradeoff)

## Taught in

- [Decision Trees and Forests](https://learn.benibix.com/learn/ai-machine-learning/decision-trees-and-forests): Machine Learning, 10/18

![Top row, random forest: three trees side by side each give a vote, and the most common vote wins. Bottom row, gradient boosting: three trees in a chain, each one fixing the errors left by the one before.](https://learn.benibix.com/diagrams/ml-forest-boosting.svg)

---

Source: https://learn.benibix.com/term/ai/ensemble-learning
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-17
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
