Dataford
Interview QuestionsInterview GuidesExperiencesMock InterviewsPricing
Get started

Online vs Batch Model Serving

Medium
MediumSystem DesignFeature StoreRetrievalModel Serving
Asked 2w ago|
Experis Nederland
Experis Nederland
Asked 12 times

Problem

Scenario

You are building an ML powered ranking system for a consumer product feed. Some predictions can be precomputed ahead of time, while others depend on fresh user context and must be computed at request time. You need to decide how to split inference between batch and online paths.

Question

What are the trade-offs between online and batch serving for ML models?

What this tests

  • Choosing between batch and online inference by feature volatility
  • Designing a retrieval → ranking → re-ranking stack
  • Using a feature store to reduce training-serving skew
  • Handling feature drift, fallback paths, and monitoring
Practicing as: AI Engineer interview at Experis Nederland

Hi, I'll play your Experis Nederland interviewer for the AI Engineer role. Candidates describe these interviews as mostly positive and moderately difficult, so expect me to be friendly and conversational. Take your time with the question above and answer like we're in the room.

Take this as a live interview session →

You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.

Sign up freeI have an account
Sign up to unlock solutions
Experis Nederland AI Engineer Interview QuestionsGoogle DeepMind Research Engineer Interview QuestionsEY-Parthenon Machine Learning Engineer Interview QuestionsTotalEnergies Data Scientist Interview QuestionsAlgolia Engineering Manager Interview Questions
Next questions
Goliath PartnersChoose Online vs Batch ServingHardElevenLabsDesign Online and Batch ML ServingHardNintendo of AmericaBatch vs Online LearningMedium