# Existential Risk from AI

> The risk that future AI could wipe us out, or ruin our future for good.

**Field:** Artificial Intelligence  
**Category:** Safety & Security  
**Also known as:** AI Existential Risk, X-Risk, AI Extinction Risk

## Think of it like

It is like lighting a fire you cannot put out. Once it spreads, there is no second try.

## Definition

Existential risk from AI is the risk that very strong AI could one day wipe out humans, or ruin the future of all people for good. The worry is not today's chatbots, but future systems far smarter than us that chase goals we did not mean. Some experts see this as a real danger. Others think it is far off, or will not happen. In 2023, many top AI scientists and lab heads signed a one-line statement. It said the risk of extinction from AI should be a world priority, like pandemics and nuclear war.

## Example

A lab plans to train a much stronger model. First it tests if the model could slip out of control or help build weapons, because that kind of mistake could not be undone.

## Why it matters

A mistake you can fix is a lesson. A mistake you cannot undo has to be stopped before it happens.

## Common mistake

Thinking it is only about killer robots in films. The main worry is a very able system chasing the wrong goal.

## Three principles

- **No second try.** Some harms cannot be undone.
- **Future systems.** Not today's chatbots.
- **A real debate.** Experts disagree on how likely it is.

## Related terms

- [AI Safety](https://learn.benibix.com/term/ai/ai-safety)
- [AI Alignment](https://learn.benibix.com/term/ai/ai-alignment)
- [Superintelligence](https://learn.benibix.com/term/ai/superintelligence)
- [Artificial General Intelligence (AGI)](https://learn.benibix.com/term/ai/artificial-general-intelligence)
- [Scheming (AI)](https://learn.benibix.com/term/ai/scheming)
- [Frontier Safety Policy](https://learn.benibix.com/term/ai/frontier-safety-policy)

![A ladder of AI risks, with an arrow up for harder to undo. At the bottom, today's harms: bias, scams and false facts. Above that, serious misuse such as help with weapons or cyber attacks. Above that, scheming: a model hides its goal and passes the tests. At the top, highlighted, existential risk: loss of control with no second try.](https://learn.benibix.com/diagrams/ai4-risk-scale.svg)

---

Source: https://learn.benibix.com/term/ai/existential-risk
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-18
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
