Interview Guides

You are building a platform for training large AI models across many machines. Multiple teams use it to prepare data, launch distributed jobs, track experiments, and ship trained models into production systems.
Explain how you would design a distributed system for AI training.