Explain how you would handle an error in your data transformation pipeline for Citi's data workflows.
Use the tables below to identify the most recent failed step for each pipeline. If a pipeline has no failed steps, it should not appear in the result.
pipeline_name, latest_failed_step, failed_at, error_codefailed_at descending, then pipeline_name ascendingfailed_at is NULLstep_id.| Column | Type | Description |
|---|---|---|
| pipeline_idPK | INT | Unique pipeline identifier |
| pipeline_name | VARCHAR(100) | Pipeline name |
| owner_team | VARCHAR(100) | Team responsible for the pipeline |
| Column | Type | Description |
|---|---|---|
| step_idPK | INT | Unique step record identifier |
| pipeline_id | INT | Pipeline identifier |
| step_name | VARCHAR(100) | Transformation step name |
| status | VARCHAR(20) | Execution status such as SUCCEEDED or FAILED |
| failed_at | TIMESTAMP | Timestamp when the step failed |
| error_code | VARCHAR(20) | Failure code returned by the workflow |