Real-Time Inference Latency

Hard

System Designinference latency

Problem

How would you optimize inference latency for a real-time trading model at Citi?

Practicing as: AI Engineer interview at Citi

Hi, I'll play your Citi interviewer for the AI Engineer role. Candidates describe these interviews as mostly positive and moderately difficult, so expect me to be friendly and conversational. Take your time with the question above and answer like we're in the room.

You are practicing as a guest. Sign up free to get your answer graded with AI feedback. Your draft stays right here.

Next questions

Optimizing Inference Under LatencyHard

Batch vs Real-Time InferenceMedium

Optimize Inference Latency for Real TimeHard