Explain Self-Attention in Transformers

Scenario

You are discussing transformer models in an LLM interview. The interviewer wants to check whether you can explain the core mechanism clearly, not just repeat high-level definitions.

Question

Explain the self-attention mechanism and why it is important in transformer models.