Optimize Memory-Heavy JSON Processing | Dataford Interview Questions

Optimize a memory-intensive data transformation script that processes large JSON payloads from model inference responses.

Implement transform_responses(chunks), where chunks is a list of strings whose concatenation is a JSON array. Return one dictionary per response with its id and the concatenation of all text values in its output array. Process the input incrementally rather than parsing the complete payload with one large json.loads call.

Input and Output

chunks is a list of strings. Return a list of dictionaries in input order, with keys id and text.

Constraints

The concatenated chunks form a valid JSON array.
Each response has an id and an output list.
Each output segment has a text string.
The number of responses is at most 1,000.

Function Signature

def transform_responses(chunks):

Your question is Optimize Memory-Heavy JSON Processing. Start with the requirements in the Question tab.

Run and submit as often as you like. When you're ready, talk me through your approach or go straight to the code.

Problem