Welcome to your interview for the Data Engineer role at Robotics Technologies.
The question is on your right: Unit Testing Python ETL with PySpark. Take a moment with it first.
Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen. You have three graded attempts to score 7/10 or better.
How do you write unit tests for a Python-based ETL process that uses PySpark or Pandas?