Write a SQL query to reconcile duplicate or missing certification records and ensure data integrity.
Return every required certification, including those without a matching record. Also include certification records that do not correspond to a requirement. Treat multiple records for the same organization and certification as duplicates, and flag records with a missing certificate number as invalid.
Output
- One row per required or unexpected organization and certification
- Columns:
organization_id, organization_name, certification_code, is_required, record_count, duplicate_count, integrity_status
- Include statuses for
VALID, MISSING, DUPLICATE, INVALID, and UNEXPECTED_RECORD
- Order by
organization_id, then certification_code