Skip to content
BENIBIX Learn

Evaluator-Optimizer Loop

AI🤖 AI AgentsAgent Orchestration

Also known as Evaluator-Optimizer, Generator-Critic Loop, Generator-Evaluator Pattern

One model makes a draft and a second one judges it. They repeat until it passes.

Think of it like

It is like a writer and a teacher. The writer hands in a page. The teacher marks it, and the writer tries again.

Example

Lucy's app translates poems. One model translates, a second model checks the tone and meaning and lists what is off, and after three rounds the judge says pass.

Why it matters

Some work gets much better with honest notes. A separate judge with clear rules gives them every round.

Definition

An evaluator-optimizer loop is a pattern where one model makes something and another model judges it. The first model writes a draft. The second checks it against clear rules and sends back notes. The first model uses the notes to write a better draft. They repeat this until the judge is happy or a set number of rounds runs out.
The middle panel is the loop. A writer model and a checker model pass the draft back and forth until it passes.

Common mistake

Giving the judge no clear rules. Vague notes like make it better send the loop round in circles.

Key takeaways

  1. 1
    Two roles. One model makes, one model judges.
  2. 2
    Clear rules. The judge checks against stated goals.
  3. 3
    A round limit. Stop on a pass or after a set number.

Compare