Ingestion Joins and PySpark DataFrames | Dataford Interview Questions

Asked me to write pyspark code to get result with all columns from datafrmse and 1 column from dataframe2 and SQL query for inner and full join

Use the two tables below for the SQL part. Write queries that return the requested join outputs.

Output

For the first result, return all columns from dataframe1 plus status from dataframe2.
For the second result, return only rows that match in both tables.
For the third result, return all rows from both tables, keeping unmatched rows with NULL values where needed.

dataframe1

dataframe2

Column	Type	Description
idPK	INT	Row identifier
status	VARCHAR(30)	Status value to bring into the result

Your question is Ingestion Joins and PySpark DataFrames. Start with the requirements and the two tables in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Asked me to write pyspark code to get result with all columns from datafrmse and 1 column from dataframe2 and SQL query for inner and full join

Use the two tables below for the SQL part. Write queries that return the requested join outputs.

For the first result, return all columns from dataframe1 plus status from dataframe2.
For the second result, return only rows that match in both tables.
For the third result, return all rows from both tables, keeping unmatched rows with NULL values where needed.

dataframe1

dataframe2

Column	Type	Description
idPK	INT	Row identifier
status	VARCHAR(30)	Status value to bring into the result

Your question is Ingestion Joins and PySpark DataFrames. Start with the requirements and the two tables in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.