PySpark Data Quality - Alphabetic Names | Dataford Interview Questions

Write a PySpark DQ check to Ensure the employee_name column contains only alphabets. Discard entries like vivek123, vivek&, etc.

Asked in the Round 2 stage. For grading, implement the equivalent transformation as a standard-library Python function. The function receives a list of row dictionaries and returns only rows whose non-null employee_name fully matches [A-Za-z]+, preserving row order and all original fields.

Function Contract

def filter_valid_employee_names(rows):

Return a list of dictionaries. Empty strings, whitespace, digits, punctuation, spaces, and null values are invalid.

Constraints

0 <= len(rows) <= 100000
Each row is a dictionary containing an employee_name key
employee_name is a string or null
A valid name contains one or more ASCII letters from A-Z or a-z
Preserve the input order and all fields of retained rows

Function Signature

def filter_valid_employee_names(rows):

Your question is PySpark Data Quality - Alphabetic Names. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem