concept:chain-rule
Chain Rule
Chain Rule in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Neural networks from scratch
Backpropagation without magic
Use backpropagation without magic to move the neural networks production brief toward a defensible release.
Neural networks from scratchSGD, momentum, AdamW, and schedules
Use sgd, momentum, adamw, and schedules to move the neural networks production brief toward a defensible release.
Neural networks from scratchRegularize, normalize, debug, and ship
Use regularize, normalize, debug, and ship to move the neural networks production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.