concept:chain-rule
Chain Rule
Chain Rule in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Neural networks from scratch
Backpropagation without magic
Backprop becomes ordinary once every edge in the forward graph has a local derivative you can inspect.
Neural networks from scratchSGD, momentum, AdamW, and schedules
The trained state is parameters plus optimizer history, schedule position, data order, and randomness.
Neural networks from scratchRegularize, normalize, debug, and ship
Shipping a network means freezing its inference behavior, not merely saving its weights.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.