concept:rest-grpc
Rest Grpc
Rest Grpc in the context of production machine-learning systems.
Lessons
Formal explanations, examples, simulations, and checkpoints.
Serving & inference systems
Choose batch, online, streaming, edge, or hybrid
Use choose batch, online, streaming, edge, or hybrid to move the serving systems production brief toward a defensible release.
Serving & inference systemsPackage model, preprocessing, schema, and runtime
Use package model, preprocessing, schema, and runtime to move the serving systems production brief toward a defensible release.
Serving & inference systemsFeatures, batching, caching, and backpressure
Use features, batching, caching, and backpressure to move the serving systems production brief toward a defensible release.
Courses & assignments
Dependency-authoritative learning units.
Casebook
Reported facts and course reconstructions.