Interview Guides
"Walk through how you would implement a custom PyTorch training loop for a multi-modal transformer that supports gradient accumulation and mixed-precision training. Explain the order of forward pass, loss scaling, backward pass, optimizer stepping, and the main failure cases you would guard against."