Skip to content
BENIBIX Learn

Constitutional AI

Also known as CAI, AI Constitution, RLAIF

Training a model with a written list of rules. It checks and fixes its own answers.

Think of it like

It is like a kid who checks their own work with a list of rules. Then they fix it.

Example

Anthropic made this method public in 2022 and used it to train Claude. One kind of rule asks for the answer that is the least harmful.

Why it matters

The rules are written down where anyone can read them. That makes it clearer why a model acts the way it does.

Definition

Constitutional AI is a way to train a model with a written list of rules, called a constitution. The model writes an answer, checks it against the rules, and then rewrites it. Those better answers are used to train it. An AI also judges which of two answers fits the rules best, in place of many human raters. This makes the rules easy to read and change.
Write, check against the rules, rewrite, and train on the better answer.

Common mistake

Thinking the list of rules is all that runs at answer time. The rules shape training. The model then acts on what it learned.

Key takeaways

  1. 1
    A written list. Of principles.
  2. 2
    Self-critique. Check and rewrite.
  3. 3
    AI feedback. In place of many raters.