Your question is Batch Processing with LLM. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
Design a batch processing system that ingests support tickets data and uses a 3rd-party LLM provider to summarise it, plus pseudocode for how you would do rate limiting.
Asked in the onsite 1 stage. Reported follow-ups: rate limiting pseudocode.
Explain the ingestion, batching, retry, persistence, and summarization workflow. Show how you would handle provider quotas, failures, duplicate processing, and resumability. Include pseudocode for rate limiting and discuss how you would test and monitor the system.