PySpark Join and Projection | Dataford Interview Questions

Write a PySpark code to process the following tables: Emp table: Emp id, name, salary, location; Table 2: Empid, emp_designation. Output: Empid, emp_name, emp_designation

Asked in the Techno Managerial stage. Join employee table with designation table.

Output

One row per employee present in both tables.
Return Empid, emp_name, and emp_designation.
Keep only matched employee records and sort the result by Empid in ascending order.

Schema

emp

Column	Type	Description
emp_idPK	INT	Unique employee identifier
name	VARCHAR(100)	Employee name
salary	NUMERIC(12,2)	Employee salary
location	VARCHAR(100)	Employee location

designation

Column	Type	Description
empid	INT	Employee identifier referencing emp.emp_id
emp_designation	VARCHAR(100)	Employee designation

Your question is PySpark Join and Projection. Start with the requirements and the two tables in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem