1
Software Engineering
Model serving architecture
Design model serving infrastructure. Cover: Load balancing, Caching, Batching, A/B testing, Canary deployment, Rollback, Monitoring.
Version Notes
Model serving architecture