concept:pinned-memory
Pinned Memory
Pinned Memory in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
GPU-aware training
Mixed precision without NaNs
Mixed precision is trustworthy only when dtype choices, loss scaling, skipped steps, and quality parity are all observable.
GPU-aware trainingActivations, accumulation, and checkpointing
Checkpointing trades compute for activation memory; accumulation trades update frequency for batch memory—measure and validate each trade separately.
GPU-aware trainingProfile from timeline to cost per sample
Profile a controlled workload, explain the timeline, and judge improvements by cost to an unchanged quality target.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.