Welcome to your interview.
The question is on your right: Transformer Architecture Fundamentals. Take a moment with it first.
Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes). Discussion and graded submissions share your five interviewer interactions, so spend them well.
You are discussing modern sequence models and how they differ from older recurrent approaches. The goal is to explain the core ideas clearly enough that someone could reason about when and why Transformers are used.
Explain Transformers.