Whenever you're ready, walk me through how you'd approach this.
Design a system for real-time data processing. What components would you include?
Describe a production-ready architecture from event producers through ingestion, processing, storage, and downstream serving. Explain technology choices, delivery semantics, partitioning, schema management, data quality, observability, failure recovery, and how the design would scale. Include representative implementation details and discuss trade-offs between latency, consistency, durability, and operational complexity.