📈Regularization
Also known as Regularisation, L1 Regularization, L2 Regularization, Weight Decay
Ways to stop a model from memorising. They keep it simpler.
Think of it like
Think of it like a rule that says keep your answer short. It stops you from rambling.
Example
Emma's model overfits, with 98 percent on training and 75 on validation. She adds a penalty on big weights. Training drops to 92, but validation climbs to 86.
Why it matters
Definition
Common mistake
Key takeaways
- 1Fights overfitting. Stops too close a fit.
- 2A penalty on size. Big weights cost extra.
- 3Simpler is safer. Better on new data.