Your question is Batch vs Real-Time Inference. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
What is the difference between batch inference and real-time inference?
Explain how the two serving patterns differ in latency, throughput, resource usage, freshness, monitoring, and evaluation. Describe when each approach is appropriate and identify the metrics or validation checks you would use to compare them in practice.