🛡️Interpretability (AI)
Also known as AI Interpretability, Model Interpretability
Looking inside an AI to see how it gets its answers.
Think of it like
It is like opening a clock. You look at the gears to see how the hands move.
Example
Emma's model sorts loan forms. A tool that looks inside shows it leans hard on where the person lives. So her team checks if that hides a bias.
Why it matters
You cannot fully trust what you cannot see into. Looking inside can catch problems that tests of the answers miss.
Definition
Common mistake
Key takeaways
- 1Look inside. Not just at answers.
- 2Trace the parts. That were active.
- 3Young field. Much still unknown.