Your question is LLM System. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
Design an LLM (Large Language Model) system
Asked in the Round 3: Behavioral Interview & System Design stage. System design component of the third round.
Describe how you would clarify requirements, select or fine-tune a model, build retrieval and ranking components where appropriate, serve inference, and evaluate the system. Discuss online and batch processing, data and feedback pipelines, latency and cost, monitoring, feature or prompt drift, training-serving skew, and failure handling. State the assumptions and scale questions you would ask before committing to capacity estimates.