Your question is Cloud Service Discovery and Load Balancing. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
How do you handle service discovery and load balancing in a cloud-native environment?
Discuss how you would expose and locate ML inference services, distribute traffic across healthy instances, handle deployments and failures, and choose between client-side and platform-managed approaches. Include operational considerations such as observability, configuration consistency, autoscaling, and fallback behavior.