📏Faithfulness (AI)
Also known as Answer Faithfulness, Groundedness, Faithfulness Score
Whether an AI answer only says what its source text backs up. It matters most when the AI answers from your files.
Think of it like
It is like a book report that only says what is in the book. Nothing is made up.
Example
Lucy's help bot answers from the company handbook. A judge model finds that 46 of 50 claims in its answers are in the handbook, so faithfulness is 92%.
Why it matters
It catches made-up claims in apps that answer from your own files. Those claims sound just as sure as true ones.
Definition
Common mistake
Key takeaways
- 1Claim by claim. Split the answer and check each part.
- 2Source is the judge. Backed by the text it was given.
- 3Not the same as true. True but unbacked still fails.