🛡️Data Poisoning
Also known as Training Data Poisoning, Backdoor Attack, Poisoning Attack
An attack that hides bad samples in what an AI learns from.
Think of it like
It is like slipping a few wrong pages into a schoolbook. Kids learn the wrong thing and do not notice.
Example
An attacker posts pages where a made-up trigger word is always followed by nonsense. A model trained on the web picks them up. Later, it prints nonsense whenever it sees that word.
Why it matters
Nobody can read every page a model trains on. A small, hidden change in the data can ship inside the model.
Definition
Common mistake
Key takeaways
- 1Bad data in. Before training.
- 2Backdoor. A hidden trigger.
- 3Few examples. Can be enough.