🛡️Mechanistic Interpretability
Also known as Mech Interp, Circuit Analysis
Looking at the parts in a model that each hold one idea.
Think of it like
It is like taking a toy apart. You name each part, and see how it works.
Example
Researchers find a feature in a model for the Golden Gate Bridge. When they turn it up by hand, the model brings the bridge into every answer.
Why it matters
If you can find the parts that stand for lying or harm, you can watch for them, or even switch them off.
Definition
Common mistake
Key takeaways
- 1Features. One idea each.
- 2Circuits. Features working together.
- 3Read, not guess. The reasoning itself.