📈Bias-Variance Tradeoff
Also known as Bias-Variance Trade-off, Bias and Variance
Too simple misses the same way each time. Too complex jumps around.
Think of it like
Think of it like throwing darts. You can miss to one side each time, or hit all over the board.
Example
Jack tries trees with depth 2, 6 and 20. Depth 2 underfits, depth 20 overfits, and depth 6 scores best on new data.
Why it matters
It explains why the most complex model is not always the best. Good models sit in the middle.
Definition
Common mistake
Key takeaways
- 1Bias. Too simple, misses the same way.
- 2Variance. Too touchy, changes with the data.
- 3Find the middle. Where the total error is lowest.