303Course · Practitioner
Optimization and Gradient Descent
How models actually learn.
- 01
Derive gradient descent.
- 02
Distinguish the modern optimizers.
- 03
Debug a divergent training run.
- 04
Reason about learning-rate schedules.
- IModule
The theory
The core.
- IIModule
The modern toolbox
The optimizers that ship.