Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Mitigate Data Skew in Joins

HardSQL · PostgreSQL00:00
Practice interviewer
In session
5 left
00:00

Your question is Mitigate Data Skew in Joins. Start with the requirements and the two tables on the right.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

You need to log in / sign up to run or submit.

Problem

What is data skew, and what strategies would you use to mitigate it in a large-scale join operation?

Using the provided PostgreSQL tables, demonstrate one SQL-based mitigation by assigning four deterministic salt buckets to fact rows and replicating dimension rows across those buckets. Flag join keys with at least three fact rows.

Output

  1. Return one row per matched event with event_id, customer_id, event_type, segment, salt_bucket, key_event_count, and is_skewed.
  2. Include only matched events, ordered by customer_id and event_id.

Schema

customer_events
ColumnTypeDescription
event_idPKINTUnique event identifier
customer_idVARCHAR(30)Customer associated with the event
event_typeVARCHAR(20)Type of customer event
event_dateDATEDate the event occurred
customer_accounts
ColumnTypeDescription
customer_idPKVARCHAR(30)Unique customer identifier
segmentVARCHAR(20)Customer segment
regionVARCHAR(20)Customer operating region
Tablescustomer_eventscustomer_accounts
Your solutionPostgreSQL
You need to log in / sign up to run or submit.
Run a query to see results