Core Data Structures and Spark Basics | Dataford Interview Questions

Tell me about your experience with basic programming data structures and distributed data computing with Spark.

Implement the map-and-reduce portion in Python: aggregate values for identical keys, then return the k largest totals. Break ties by ascending key order. Use def top_k_aggregates(records, k):, where records is a list of [string, integer] pairs and the output is a list of [key, total] pairs.

Constraints

1 <= len(records) <= 1000
1 <= k <= 1000
Each record contains a non-empty string key and an integer value
Keys may repeat
If totals tie, return keys in ascending lexicographic order

Function Signature

def top_k_aggregates(records, k):

Your question is Core Data Structures and Spark Basics. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem

Tell me about your experience with basic programming data structures and distributed data computing with Spark.

Constraints

1 <= len(records) <= 1000
1 <= k <= 1000
Each record contains a non-empty string key and an integer value
Keys may repeat
If totals tie, return keys in ascending lexicographic order

Function Signature

def top_k_aggregates(records, k):

Your question is Core Data Structures and Spark Basics. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.