# AI Red Teaming

> Attacking your own AI on purpose to find its weak spots first.

**Field:** Artificial Intelligence  
**Category:** Safety & Security  
**Also known as:** Red Teaming, LLM Red Teaming, Red Team (AI)

## Think of it like

It is like asking a friend to try to get into your house. Then you fix the locks.

## Definition

AI red teaming means attacking your own AI on purpose, to find weak spots before others do. A red team tries jailbreaks, prompt injection, requests for harm and odd cases. It can be people, other AI models that write attacks, or both. Each attack that works is logged, fixed, and tried again. Many model makers red team each big model before release. They often bring in outside experts in fields such as biology or hacking.

## Example

Before launch, Jack's team gives a red team two weeks with their support bot. They find a way to make it reveal another customer's order, and fix it before release.

## Why it matters

Normal testing checks that things work. Red teaming checks how they break, which is what attackers will try.

## Common mistake

Doing it once before launch. New features, tools and attack ideas mean it has to be repeated.

## Three principles

- **Attack yourself.** On purpose.
- **People and AI.** Both attack.
- **Log, fix, retry.** And repeat.

## Related terms

- [Jailbreak (AI)](https://learn.benibix.com/term/ai/jailbreak)
- [Prompt Injection](https://learn.benibix.com/term/ai/prompt-injection)
- [LLM Evaluation](https://learn.benibix.com/term/ai/llm-evaluation)
- [AI Safety](https://learn.benibix.com/term/ai/ai-safety)
- [Guardrail (AI)](https://learn.benibix.com/term/ai/guardrail)
- [Dangerous Capability Evaluation](https://learn.benibix.com/term/ai/dangerous-capability-evaluation)

## Told apart from

- [AI Red Teaming vs Dangerous Capability Evaluation](https://learn.benibix.com/compare/ai-red-teaming-vs-dangerous-capability-evaluation): People think red teaming and a danger test are the same check, and they are not. A red team tries to make a model break its rules, with tricks like jailbreaks and hidden orders. A danger test asks what the model can do at its strongest, such as help with a weapon or a break-in. One looks for holes in the rules. The other measures the power behind them.

![A red team attacks a model with many tricks before launch. Each attack that works is logged, fixed, and tried again.](https://learn.benibix.com/diagrams/sf-ai-red-teaming.svg)

---

Source: https://learn.benibix.com/term/ai/ai-red-teaming
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-18
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
