Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Recover a Failed Batch Job

HardPipelines00:00
Practice interviewer
In session
5 left
00:00

Your question is Recover a Failed Batch Job. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Scenario

You're operating a daily data pipeline that processes a large batch and writes results into analytics tables used by downstream reporting and operational workflows. One day, the job fails after completing part of the run, and you need to recover it without creating duplicates, losing rows, or leaving consumers with partial data.

Question

How do you handle a scenario where a daily batch job fails halfway through processing 100 million rows?