Skip to content
BENIBIX Learn

Self-Consistency (Prompting)

AI🛠️ Working with AIPrompt Writing Techniques

Also known as Self-Consistency Decoding, Majority Vote Prompting

Ask the same question many times. Keep the answer most runs agree on.

Think of it like

It is like asking five friends the same sum. You trust the answer most of them give.

Example

The 2022 paper that named it tested school math problems. Taking a vote over many answers lifted the score by 17.9 points over a single answer.

Why it matters

It turns a model's randomness into a strength. It works best when there is one right answer to check.

Definition

Self-consistency is a way to get better answers on hard questions. You ask the model the same question many times. Each time it works the steps out in its own way. Then you count the final answers and keep the one that shows up most. A wrong path tends to land on a different answer each time. A right path tends to land on the same one.
This runs many paths side by side. Then it takes a vote on the answers.

Common mistake

Using it for open writing, like a poem. There is no single answer to vote on there.

Key takeaways

  1. 1
    Many runs. The same question, asked again and again.
  2. 2
    Count the answers. The most common one wins.
  3. 3
    Costs more. Ten runs cost ten times the tokens.

Learn it properly