💻Model Pruning
Also known as Pruning (AI), Neural Network Pruning, Weight Pruning
A way to shrink a model. The parts it needs least are cut out.
Think of it like
Think of it like trimming a bush. You cut the weak twigs, and it still looks like the same bush.
Example
A team prunes a quarter of the layers from a speech model and trains it for one more day. It runs a third faster on phones and scores almost the same.
Why it matters
Definition
Common mistake
Key takeaways
- 1Cut what matters least. Weights or whole parts.
- 2Train a little more. To recover.
- 3Whole parts for speed. Scattered cuts save space.