🛡️Jailbreak (AI)
Also known as AI Jailbreak, LLM Jailbreak, Jailbreaking
A trick prompt that gets an AI to break its own rules.
Think of it like
It is like telling a guard a long tale. Then they let you in.
Example
A user asks a model for something it refuses. They then ask it to play a character in a story who would explain it. An older model plays along and answers.
Why it matters
A model that can be talked out of its rules is only as safe as its worst user.
Definition
Common mistake
Key takeaways
- 1Breaks safety rules. Of the model.
- 2Wrapped request. Story, role, code.
- 3Patched, then found. Over and over.