📏Eval Rubric
Also known as Evaluation Rubric, LLM Grading Rubric
A written checklist for grading AI answers. Each line says what earns a point.
Think of it like
It is like the marking sheet a teacher uses. Each line says what earns a mark.
Example
Emma's rubric for support replies has four lines: the right answer, a link to the policy, under 120 words, and a kind tone. Her judge model marks each line.
Why it matters
Without a rubric, graders judge by mood and scores drift. With one, a change in score means the answers changed.
Definition
Example code
text
Score each line 0 or 1.
1. Gives the 30-day refund window.
2. Links to the refund policy page.
3. Is under 120 words.
4. Is polite and does not blame.
Scores: 1, 1, 0, 1. Total: 3 of 4.Common mistake
Key takeaways
- 1One thing per line. Easy to mark yes or no.
- 2Shared by graders. People and judges mark alike.
- 3Written first. Decide what good is before grading.