📈XGBoost
Also known as Extreme Gradient Boosting, XGBoost Library
A fast, free tool for boosted trees. Often the best pick for table data.
Think of it like
It is like a well-tuned race bike. Same idea as a bike, built to go fast.
Example
Jack predicts which customers will cancel. He feeds 20 columns of account data to XGBoost, and it beats his neural network.
Why it matters
It gives top results on spreadsheet-style data with little effort. Many real systems still run on it.
Definition
Example code
python
import xgboost as xgb
model = xgb.XGBClassifier(n_estimators=200, max_depth=4)
model.fit(X_train, y_train)
model.predict(X_test[:1])
# array([1])Common mistake
Key takeaways
- 1Gradient boosting. A chain of trees fixing errors.
- 2Built for speed. Uses many cores and machines.
- 3Table data. Rows and columns, not photos.