Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Diagnose an Integration Pipeline Issue

Medium
PipelinesToolsDependenciesQuality
Asked 1mo ago|
Exl
Exl
Asked 154 times

Problem

Scenario

You're supporting a customer-facing data integration and need to troubleshoot why data is missing, delayed, or incorrect. You want a clear way to isolate whether the problem is in extraction, transformation, loading, scheduling, or downstream mapping.

Question

What steps would you take to diagnose a customer issue with an integration?

What to Inspect

Connector auth status and last successful sync
Airflow DAG run history and retry behavior
SQS backlog, DLQ volume, and worker errors
Snowflake raw vs curated row counts
dbt freshness and test failures

Reference Stack

  • Ramp connector service
  • Apache Airflow 2.8
  • Amazon SQS + DLQ
  • Amazon S3 Parquet staging
  • Snowflake raw and curated tables
  • dbt Core 1.7

You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.

Sign up freeI have an account
Sign up to unlock solutions
KMS Technology Data Engineer Interview QuestionsAxon Data Engineer Interview QuestionsItron Solutions Architect Interview QuestionsEightfold Solutions Architect Interview QuestionsExl Data Engineer Interview Questions
Next questions
HD SupplyDiagnose Source vs Pipeline IssuesMediumLeidosTroubleshoot Intermittent Integration FailuresMediumDevoteamMonitor Customer Integration PipelinesHard
0 / ~200 words