Prompt Injection vs Jailbreak
People often think prompt injection and a jailbreak are the same attack. In a jailbreak, the user tricks the model into breaking its own safety rules. In prompt injection, someone else's text takes over an app. It hides in a message, a page or a file that the app trusts. A jailbreak aims at the model's training. Injection aims at the app built on it, and the user may never see it.
Prompt Injection
An attack that hides new orders in text the AI reads.
Prompt injection is an attack that sneaks new orders into the text an AI model reads. The model cannot always tell the builder's orders apart from text that only looks like orders. So a line such as 'ignore your rules' inside a message can change what it does. It is the AI form of SQL injection, where data gets treated as a command. There is no full fix yet, so apps limit what the model can do.
Jailbreak (AI)
A trick prompt that gets an AI to break its own rules.
A jailbreak is a prompt written to get a model to break its own safety rules. A plain request for harm is often refused. A jailbreak hides it in a story, a game of pretend, a code, or many small steps, until the model goes along. The user is the one doing it, and the target is the model's own training. Model makers patch the known ones, and people keep finding new ones.
In one line
- Prompt Injection
- An attack that hides new orders in text the AI reads.
- Jailbreak (AI)
- A trick prompt that gets an AI to break its own rules.