concept:delayed-labels
Delayed Labels
Delayed Labels in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Reliability, monitoring & experimentation
ML SLIs, SLOs, error budgets, ownership
Use ml slis, slos, error budgets, ownership to move the reliability production brief toward a defensible release.
Reliability, monitoring & experimentationObserve system, data, prediction, and business
Use observe system, data, prediction, and business to move the reliability production brief toward a defensible release.
Reliability, monitoring & experimentationDiagnose, mitigate, and write postmortems
Use diagnose, mitigate, and write postmortems to move the reliability production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.