concept:temporal-splits
Temporal Splits
Temporal Splits in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Problem framing, statistics & evaluation
Baselines and honest splits
Use baselines and honest splits to move the evaluation production brief toward a defensible release.
Problem framing, statistics & evaluationMetrics, thresholds, and calibration
Use metrics, thresholds, and calibration to move the evaluation production brief toward a defensible release.
Problem framing, statistics & evaluationUncertainty and online experiments
Use uncertainty and online experiments to move the evaluation production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.