concept:drift
Drift
Drift in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Reliability, monitoring & experimentation
Observe system, data, prediction, and business
Observability becomes diagnosis only when every layer can be joined by exact version, request, time, and slice.
Reliability, monitoring & experimentationDiagnose, mitigate, and write postmortems
Mitigate harm quickly, preserve causality carefully, and make the postmortem change the system rather than the story.
Reliability, monitoring & experimentationRandomized experiments and guardrails
Trust an experiment only after assignment, exposure, unit of analysis, uncertainty, and guardrails all agree.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.