Python, SQL, Cleansing, and Airflow | Dataford Interview Questions

Tell me about your experience with Python, SQL, data cleansing, and Airflow.

For the coding portion, implement clean_records(records). Normalize names and email addresses, discard records with missing or malformed values, and deduplicate by normalized email while retaining the record with the latest timestamp. Return valid records sorted by timestamp.

Input and Output

records is a list of dictionaries containing string keys name, email, and event_time. Return a list of cleaned dictionaries with the same keys. Timestamps use the ISO format YYYY-MM-DDTHH:MM:SS.

Constraints

0 <= len(records) <= 1000
Each record is a dictionary containing name, email, and event_time keys
event_time uses the format YYYY-MM-DDTHH:MM:SS
Email comparison is case-insensitive and ignores surrounding whitespace
For equal timestamps, retain the first valid record encountered

Function Signature

def clean_records(records):

Your question is Python, SQL, Cleansing, and Airflow. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem