Owning a Training Instability Incident

The Question

"Tell me about a time a distributed training run suddenly became unstable—for example, losses went to NaN or gradients exploded—and you had to lead the response. Walk me through how you diagnosed the issue, how you coordinated with others, and how you balanced getting the run back online with learning enough to prevent it from happening again."