concept:cross-entropy
Cross Entropy
Cross Entropy in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Neural networks from scratch
Forward pass, activations, losses, and initialization
Use forward pass, activations, losses, and initialization to move the neural networks production brief toward a defensible release.
Neural networks from scratchBackpropagation without magic
Use backpropagation without magic to move the neural networks production brief toward a defensible release.
Neural networks from scratchSGD, momentum, AdamW, and schedules
Use sgd, momentum, adamw, and schedules to move the neural networks production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.