ML 3.2 Free video
Gradient Descent
Find the minimum of a loss without solving equations, by stepping against the gradient, and tell from the loss curve whether a run converges, crawls or diverges.
- A loss with no formula
- One parameter, then two
- Searching a grid
- Stepping against the derivative
- The learning rate decides
- Two parameters on the cars
- Just above the limit
- The descent loop in NumPy
- Recap, your challenge, and what comes next
Key term · update rulew ← w − η · L′(w)
- A 5-question quiz, marked the moment you answer
- Practice at levels A to C, with values to check against
- Where the idea is used in real work
- Common mistakes: the error you will see, why, and the fix
- 3 notebooks to run the examples yourself
- 15 interview questions with model answers
- The module project: A Fuel-Economy Model, Built and Defended, set with no template