Your question is Designing Batch and Streaming ETL. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
Describe your approach to designing an ETL pipeline that handles both batch and real-time streaming data.
Explain how you would choose ingestion, processing, storage, orchestration, and serving technologies. Cover data modeling, schema evolution, idempotency, exactly-once or effectively-once processing, data quality, monitoring, failure recovery, and backfilling. Discuss how batch and streaming paths share logic, avoid duplicate data, and meet different latency requirements.
