ML 9.3Lesson outlineLesson 3 of 5 in Module 9
Gradient Boosting
Add trees one at a time, each fitting what is still wrong, and see it as gradient descent on the loss.
Video in production.
Lesson outline: Gradient Boosting
In this lesson12 parts
- 01Trees that fix each other
- 02Eight houses, then the forest cells
- 03What to beat
- 04A sum of trees
- 05Fit the residuals
- 06The residual is the gradient
- 07Log loss, and seven classes
- 08The learning rate and the number of trees
- 09Against the forest, then the sealed cells
- 10Where it misleads
- 11Code
- 12Recap, challenge, and what comes next
Builds on
This lesson stands on its own. These go deeper into what it uses.
- ML 9.1–9.2: Decision Trees
- 3.2–3.3
- 4.6
- 7.2
- 7.4