Skip to content
BENIBIX Learn

Existential Risk from AI

Also known as AI Existential Risk, X-Risk, AI Extinction Risk

The risk that future AI could wipe us out, or ruin our future for good.

Think of it like

It is like lighting a fire you cannot put out. Once it spreads, there is no second try.

Example

A lab plans to train a much stronger model. First it tests if the model could slip out of control or help build weapons, because that kind of mistake could not be undone.

Why it matters

A mistake you can fix is a lesson. A mistake you cannot undo has to be stopped before it happens.

Definition

Existential risk from AI is the risk that very strong AI could one day wipe out humans, or ruin the future of all people for good. The worry is not today's chatbots, but future systems far smarter than us that chase goals we did not mean. Some experts see this as a real danger. Others think it is far off, or will not happen. In 2023, many top AI scientists and lab heads signed a one-line statement. It said the risk of extinction from AI should be a world priority, like pandemics and nuclear war.
Existential risk is the top of the scale: a harm with no second try.

Common mistake

Thinking it is only about killer robots in films. The main worry is a very able system chasing the wrong goal.

Key takeaways

  1. 1
    No second try. Some harms cannot be undone.
  2. 2
    Future systems. Not today's chatbots.
  3. 3
    A real debate. Experts disagree on how likely it is.