// ◇ Classical Machine Learning

XGBoost

A highly engineered, scalable gradient-boosted tree system.

2016 Foundational core

IN PLAIN WORDS

Adds regularization, second-order gradients, sparsity-awareness and parallel/distributed training on top of GBDT. It long dominated tabular competitions.

Used in: Tabular prediction, ad CTR, risk

TIMELINE · prerequisites → this → what builds on it

2001 Gradient Boos…2016 XGBoost

01Original paper

XGBoost: A Scalable Tree Boosting System

Tianqi Chen, Carlos Guestrin · 2016

arXiv ↗ ✓ Verified · arXiv API

02Where it sits

Learn the left column first; the right column builds on this one.

Learn first

Gradient Boosting (GBDT)

XGBoost

Then you can learn

Nothing in the atlas builds on it yet

Related:LightGBM

Left: prerequisites · right: builds on this · dashed: related. Full map →

03Learning resources

Official docs, explainers, courses and reference code. All links checked.

Official docs

04Where the course teaches it

U21 Trees & Ensembles Decision trees, random forests, gradient boosting, XGBoost/LightGBM — the kings of tabular data. 8 h6 algorithms3 papers

On learning paths:Zero to Deep Learning

For AI / data

Verification: verified, checked 2026-10-21.
JSON: /api/learn/algorithms.json (id: xgboost)