Interview Guides

You are building an ML powered decision service that runs inside a distributed application. Predictions must stay available during traffic spikes, partial outages, and model rollouts, while keeping latency low and outputs consistent across regions.
How do you ensure high availability and scalability in a distributed system?