Whenever you're ready, walk me through how you'd approach this.
How would you plan for capacity in a system that needs to scale rapidly while managing costs?
Discuss the information you would gather, how you would estimate demand and infrastructure requirements, and how you would balance latency, availability, and spend. Address online and batch inference, autoscaling, capacity headroom, load testing, cost monitoring, and failure handling.