Top 50 latency Interview Questions
The most frequently asked latency questions across all roles and companies, ranked by real interview frequency. Updated daily.
Compute rolling p50 and p95 latency with a sorted sliding window and flag sudden generation spikes.
AnthropicFind the k-th smallest TikTok Shop server latency using a max-heap with O(n log k) time.
TikTok ShopExplain what an ISR does, how interrupt latency arises, and how to reduce it in embedded systems.
Nokia
Infineon Technologies
Diversified Services NetworkSign up to see every question
Create a free account to unlock this list and practice real interview questions.
Design a low latency ML inference platform for high-frequency online predictions with strict response times and evolving model features.
AnthropicSScaled CognitionPPrimaDesign an enterprise RAG system that balances retrieval quality, grounded answers, and low latency over frequently changing internal data.
Workday
Ltimindtree
Hewlett Packard Enterprise | HPEDesign a production ranking service that balances model accuracy with latency and throughput under large-scale traffic.
Chenega
Playstation Network
ENGIEDesign a low-latency, cost-aware serving platform for multiple fine-tuned LLMs under variable traffic.
Grafana Labs
Sandia National Laboratories
ClickUpDesign a real-time event pipeline that can handle millions of events per second with sub-second latency.
Alpaca
KDA Consulting
Altimate.Ai