Whenever you're ready, walk me through how you'd approach this.
How would you reduce latency in an API?
Asked in the technical round 2 stage. Explain how you would measure latency, identify bottlenecks, and improve an API that may include feature retrieval and model inference. Cover architectural changes, caching, capacity planning, fallbacks, and how you would verify that latency improvements do not degrade correctness or model quality.