Remove JSON Duplicates | Dataford Interview Questions

Write a function to identify and remove duplicate records from an incoming JSON dataset based on a composite key.

Implement deduplicate_records(records, key_fields). records is a list of JSON objects, and key_fields is a non-empty list of field names. Two records are duplicates when all corresponding values for key_fields are equal. Return a new list containing the first record for each composite key, preserving input order. Assume every key field exists and contains a JSON scalar value.

Constraints

0 <= len(records) <= 1000
1 <= len(key_fields) <= 10
Every key field exists in every record
Values used in key_fields are JSON scalar values
The first record for each composite key must be retained
The input list must not be modified

Function Signature

def deduplicate_records(records, key_fields):

Your question is Remove JSON Duplicates. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem

Write a function to identify and remove duplicate records from an incoming JSON dataset based on a composite key.

Constraints

0 <= len(records) <= 1000
1 <= len(key_fields) <= 10
Every key field exists in every record
Values used in key_fields are JSON scalar values
The first record for each composite key must be retained
The input list must not be modified

Function Signature

def deduplicate_records(records, key_fields):

Your question is Remove JSON Duplicates. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.