AI Safety vs AI Alignment
People often think AI safety and AI alignment are just two words for one thing. Alignment is one part of safety. It means making the model try to do what people meant. Safety is wider. It also covers attacks, misuse, tests and filters, and those can go wrong even when a model is aligned. A model can be aligned and still be fooled by a prompt injection.
AI Safety
The work of making sure AI does not cause harm. It runs from design to daily use.
AI safety is the work of making sure AI systems do not cause harm. It covers small harms, such as a chatbot giving bad advice, and big ones, such as a powerful system acting against people. Part of it is building models that want the right things. Part of it is testing them for harm before release. And part of it is guarding them once they are live, so a mistake or an attack is caught early.
AI Alignment
Making an AI try to do what people meant, not just what they said.
AI alignment is the work of making an AI try to do what people really want. A model learns from goals and examples, and those never say it all. So it can follow the words of a goal and miss the point. To align a model, teams train it on human feedback, give it written rules, and test how it acts in hard cases. The big open question is how to keep a model on track once it is smarter than the people who check it.
In one line
- AI Safety
- The work of making sure AI does not cause harm. It runs from design to daily use.
- AI Alignment
- Making an AI try to do what people meant, not just what they said.