Your question is Transformers and Attention. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
Explain transformers.
Discuss the transformer architecture, self-attention, positional information, encoder and decoder blocks, training objectives, and why transformers differ from recurrent networks. Include a concise practical example showing how a transformer could be trained for sequence classification, and explain the main computational and modeling tradeoffs.