🛡️Existential Risk from AI
Also known as AI Existential Risk, X-Risk, AI Extinction Risk
The risk that future AI could wipe us out, or ruin our future for good.
Think of it like
It is like lighting a fire you cannot put out. Once it spreads, there is no second try.
Example
A lab plans to train a much stronger model. First it tests if the model could slip out of control or help build weapons, because that kind of mistake could not be undone.
Why it matters
A mistake you can fix is a lesson. A mistake you cannot undo has to be stopped before it happens.
Definition
Common mistake
Key takeaways
- 1No second try. Some harms cannot be undone.
- 2Future systems. Not today's chatbots.
- 3A real debate. Experts disagree on how likely it is.