Whenever you're ready, walk me through how you'd approach this.
Explain Delta Live Tables and how a query is executed in Spark.
Cover the practical distinctions between declarative pipeline definitions and Spark execution, including DLT dependencies, expectations, checkpoints, lineage, incremental processing, and failure recovery. Explain Spark's logical plan, analysis, Catalyst optimization, physical plan generation, stages, tasks, shuffles, and execution on worker nodes. Include a concise PySpark or SQL example and describe how you would inspect and monitor the resulting pipeline.