End-to-End PySpark Script | Dataford Interview Questions

Write an end-to-end PySpark script that produces a given output table from the input data.

Asked in the Round 1 stage. Two such questions were asked in round 1, per thread 1uv9sob.

Output

Return one row per customer with customer_id, customer_name, customer_segment, completed_transaction_count, completed_amount, and activity_status.
Include only transactions with status COMPLETED from 2025-01-01 through 2025-03-31. Include customers with no qualifying transactions.
Sort by completed_amount descending, then customer_id ascending. completed_amount must be zero when no qualifying amount exists.

customers

Column	Type	Description
customer_idPK	INTEGER	Unique customer identifier
customer_name	VARCHAR(100)	Customer display name
customer_segment	VARCHAR(60)	Customer segment classification

transactions

Column	Type	Description
transaction_idPK	INTEGER	Unique transaction identifier
customer_id	INTEGER	Customer associated with the transaction
amount	NUMERIC(14,2)	Transaction amount
transaction_date	DATE	Date the transaction occurred
status	VARCHAR(60)	Transaction processing status

Your question is End-to-End PySpark Script. Start with the requirements and the two tables in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.