Dataford
Interview QuestionsInterview GuidesExperiencesCoaching
New
Pricing
Get started
Dataford
Popular roles
Software EngineerData AnalystData ScientistData EngineerBusiness AnalystAI EngineerMachine Learning EngineerProduct Manager
Browse
Browse All RolesEvery role hub, from analyst to MLBrowse All CompaniesCompany-specific interview loopsAll Interview GuidesThe full guide library
Top questions by role
Software EngineerData AnalystData ScientistData EngineerBusiness AnalystAI EngineerMachine Learning EngineerProduct Manager
Top questions by skill
SQLPythonStatisticsMachine LearningA/B TestingSystem DesignGenerative AIProduct SenseMetricsBehavioral
Browse all questions →Try a mock interview
Experiences
Practice
Mock InterviewsTimed interview simulations with feedbackCoaching1:1 coaching with people at your target companiesSuccess PathYour 6-week structured planModulesCurated lessons by topicWebinarsTalks from ex-Big Tech data leadsPlaygroundA free-form scratch editor
Learn
BlogInterview strategy and career adviceTech Job Market ReportHiring trends across data and AI rolesFor UniversitiesDataford for career centersAbout DatafordWho we are and how we build
Pricing
Build my plan
SQL Duplicate Detection at Scale
00:00
5 left

SQL Duplicate Detection at Scale

MediumSQL · PostgreSQL

Problem

SAS Customer Intelligence 360 receives event data from multiple ingestion channels. Write a PostgreSQL query that identifies repeated event records in the customer_events table, which may contain millions of rows.

Treat rows with the same customer_id, event_date, event_type, and event_amount as one business event. The record_id and ingested_at values identify individual ingested copies.

Requirements

  1. Return every row belonging to a duplicate business-event group, including the first-ingested copy.
  2. Show the number of records in each duplicate group and rank records by ingested_at, with record_id as a tie-breaker.
  3. Label the earliest copy as original and later copies as duplicate.
  4. Use a CTE and window functions. The query must retain groups where nullable business-key columns have matching NULL values.

Schema

customer_events
ColumnTypeDescription
record_idPKBIGINTUnique ingested record identifier
customer_idVARCHAR(20)SAS customer identifier
event_dateDATEDate associated with the event
event_typeVARCHAR(40)Event category
event_amountNUMERIC(12,2)Amount associated with the event
ingested_atTIMESTAMPTimestamp when the record entered the platform
source_systemVARCHAR(30)Originating ingestion channel
Tablescustomer_events
Interviewer

Your question is SQL Duplicate Detection at Scale. Start with the requirements and the one table in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

You need to log in / sign up to run or submit.
CodePostgreSQL
Sign up free to run your codeLog inLn 1
Run your query to see results here.