📏Human Evaluation
Also known as Human Review, Manual Evaluation, Human Rating
People judge the answers of an AI model. It is slow, but closest to what users think.
Think of it like
It is like a taste test at a bake sale. Real people say which cake they like best.
Example
Lucy has three nurses rate 200 answers from a health chatbot. Where they disagree, they talk it through, and the agreed grades become her ground truth.
Why it matters
In the end, people use the product. Their judgment is the standard every other check is measured against.
Definition
Common mistake
Key takeaways
- 1People judge. Score, mark or pick.
- 2Closest to users. Catches tone.
- 3Slow and costly. Use clear rules.