Whenever you're ready, walk me through how you'd approach this.
How do you approach designing data pipelines for machine learning applications?
Discuss the end-to-end design, including ingestion, batch or streaming transformations, feature preparation, data quality, orchestration, lineage, reproducibility, and delivery to training and inference systems. Include technology choices, failure recovery, monitoring, and strategies for handling schema changes and backfills.