concept:timeouts
Timeouts
Timeouts in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Serving & inference systems
Features, batching, caching, and backpressure
Use features, batching, caching, and backpressure to move the serving systems production brief toward a defensible release.
Serving & inference systemsCapacity, load testing, autoscaling, and tails
Use capacity, load testing, autoscaling, and tails to move the serving systems production brief toward a defensible release.
Serving & inference systemsShadow, canary, rollback, fallback, observability
Use shadow, canary, rollback, fallback, observability to move the serving systems production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.