Tell me how you handle missing or malformed data during ingestion.
Inspect the provided raw records and allowed event types. Return one validation result for every raw record. Treat trimmed blank values as missing, accept only calendar-valid dates in YYYY-MM-DD form, accept nonnegative decimal measurements, and require a recognized event type. Do not allow malformed values to abort the query.
source_line, record_id, ingestion_status, rejection_reason, normalized_visit_date, normalized_measurementsource_line| Column | Type | Description |
|---|---|---|
| source_linePK | INTEGER | Source row number from the ingestion file |
| record_id | VARCHAR(30) | Raw record identifier |
| raw_visit_date | VARCHAR(30) | Raw visit date text |
| raw_measurement | VARCHAR(30) | Raw numeric measurement text |
| event_type | VARCHAR(30) | Raw event type code |
| subject_code | VARCHAR(30) | Subject identifier |
| Column | Type | Description |
|---|---|---|
| event_typePK | VARCHAR(30) | Recognized event type code |
| event_description | VARCHAR(100) | Description of the recognized event type |