Second Lowest Salary with PySpark | Dataford Interview Questions

Using PySpark, read data from a Hive table and return the second lowest salary.

Asked in the Technical interview stage. The author accidentally sorted descending under time pressure. For this PostgreSQL version, use the employees table.

Output

Return one row containing second_lowest_salary.
Consider distinct non-NULL salary values.
Return the salary value in ascending rank order, with the second-lowest value selected.

Schema

employees

Column	Type	Description
employee_idPK	INT	Unique employee identifier
employee_name	VARCHAR(100)	Employee name
salary	DECIMAL(12,2)	Employee salary

Your question is Second Lowest Salary with PySpark. Start with the requirements and the one table in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem