💬Catastrophic Forgetting
Also known as Catastrophic Interference, Forgetting After Fine-Tuning
A model learns a new task and loses skills it had.
Think of it like
It is like you learn a new song so well that the old one is gone.
Example
Jack fine-tunes a chat model on his shop's help tickets. It now answers tickets well, but it starts to fail simple sums it used to get right.
Why it matters
A tuned model can pass its new test and still fail the old ones. You have to check both.
Definition
Common mistake
Key takeaways
- 1Same weights. New learning writes over old.
- 2Narrow data. Raises the risk.
- 3Mix and limit. Old data and fewer changed weights help.