📈Gradient Boosting
Also known as Gradient Boosted Trees, Boosted Trees, GBM
Many small trees built in a row. Each one fixes what the last got wrong.
Think of it like
Think of it like a team. Each new player fixes what the last one got wrong.
Example
Lucy's team predicts how many meals a restaurant will sell each day. Gradient boosting with 500 small trees beats every other model they try.
Why it matters
It wins many contests on table data. It also runs inside many real products, and good tools make it easy to use.
Definition
Common mistake
Key takeaways
- 1Trees in a row. Built one after another.
- 2Each fixes the last. Trained on what is still wrong.
- 3Strong on tables. Often the most accurate.