# Eval Rubric

> A written checklist for grading AI answers. Each line says what earns a point.

**Field:** Artificial Intelligence  
**Category:** Evaluation & Benchmarks  
**Also known as:** Evaluation Rubric, LLM Grading Rubric

## Think of it like

It is like the marking sheet a teacher uses. Each line says what earns a mark.

## Definition

An eval rubric is a written list of what makes an AI answer good. Each line names one thing to check, such as giving the right refund date or being polite. Each line gets points, or a pass or a fail. A person or a judge model goes down the list for every answer. The rubric turns a vague feeling into a score that two graders can agree on.

## Example

Emma's rubric for support replies has four lines: the right answer, a link to the policy, under 120 words, and a kind tone. Her judge model marks each line.

## Example code

```text
Score each line 0 or 1.
1. Gives the 30-day refund window.
2. Links to the refund policy page.
3. Is under 120 words.
4. Is polite and does not blame.

Scores: 1, 1, 0, 1. Total: 3 of 4.
```

A four-line rubric, and the marks one answer earned.

## Why it matters

Without a rubric, graders judge by mood and scores drift. With one, a change in score means the answers changed.

## Common mistake

Writing vague lines like 'is helpful'. Each line should be something two people would mark the same way.

## Three principles

- **One thing per line.** Easy to mark yes or no.
- **Shared by graders.** People and judges mark alike.
- **Written first.** Decide what good is before grading.

## Related terms

- [LLM-as-a-Judge](https://learn.benibix.com/term/ai/llm-as-a-judge)
- [Human Evaluation](https://learn.benibix.com/term/ai/human-evaluation)
- [Eval Set](https://learn.benibix.com/term/ai/eval-set)
- [LLM Evaluation](https://learn.benibix.com/term/ai/llm-evaluation)
- [Pairwise Evaluation](https://learn.benibix.com/term/ai/pairwise-evaluation)

![On the left, one answer is marked against a four-line rubric and gets 3 of 4. On the right, two answers sit side by side and a judge picks answer B.](https://learn.benibix.com/diagrams/ai5-llm-grading.svg)

---

Source: https://learn.benibix.com/term/ai/eval-rubric
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-19
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
