concept:dead-activations

Dead Activations

Dead Activations in the context of production machine-learning systems.

Lessons

Formal explanations, examples, simulations, and checkpoints.

Activation functions: geometry, gradients, and failure modes

Select activation functions by signal range, gradient flow, architecture, precision, and failure mode; then diagnose saturation and dead units from telemetry.

Courses & assignments

Dependency-authoritative learning units.

Casebook

Reported facts and course reconstructions.