Whenever you're ready, walk me through how you'd approach this.
Explain the trade-offs between different attention mechanisms in current large language models.
Focus on how the choice affects compute, memory, long-context quality, and deployment latency. A strong answer should compare at least three mechanisms and state when each is preferable.