concept:initialization
Initialization
Initialization in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Neural networks from scratch
SGD, momentum, AdamW, and schedules
Use sgd, momentum, adamw, and schedules to move the neural networks production brief toward a defensible release.
Neural networks from scratchRegularize, normalize, debug, and ship
Use regularize, normalize, debug, and ship to move the neural networks production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.