concept:initialization
Initialization
Initialization in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Neural networks from scratch
SGD, momentum, AdamW, and schedules
The trained state is parameters plus optimizer history, schedule position, data order, and randomness.
Neural networks from scratchRegularize, normalize, debug, and ship
Shipping a network means freezing its inference behavior, not merely saving its weights.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.