concept:pinned-memory
Pinned Memory
Pinned Memory in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
GPU-aware training
Mixed precision without NaNs
Use mixed precision without nans to move the gpu training production brief toward a defensible release.
GPU-aware trainingActivations, accumulation, and checkpointing
Use activations, accumulation, and checkpointing to move the gpu training production brief toward a defensible release.
GPU-aware trainingProfile from timeline to cost per sample
Use profile from timeline to cost per sample to move the gpu training production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.