concept:relu-gelu
Relu Gelu
Relu Gelu in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Neural networks from scratch
Beyond linear boundaries
Use beyond linear boundaries to move the neural networks production brief toward a defensible release.
Neural networks from scratchForward pass, activations, losses, and initialization
Use forward pass, activations, losses, and initialization to move the neural networks production brief toward a defensible release.
Neural networks from scratchBackpropagation without magic
Use backpropagation without magic to move the neural networks production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.