📏ROUGE Score
Also known as ROUGE, Recall-Oriented Understudy for Gisting Evaluation, ROUGE-L, ROUGE-N
A set of scores for summaries. They check how much of a person's summary was covered.
Think of it like
It is like checking a book report for the main points. You see how many of the teacher's points it has.
Example
Jack's app sums up meeting notes. He compares 200 of its summaries with ones his team wrote, and ROUGE-L goes from 0.38 to 0.45 after a prompt change.
Why it matters
Summaries are slow for people to grade. ROUGE gives a quick first check across hundreds of them.
Definition
Common mistake
Key takeaways
- 1Recall first. How much of the human version is covered.
- 2Many kinds. ROUGE-N, ROUGE-L and more.
- 3Words, not meaning. Same idea in other words scores low.