Your question is Vector Database Low Latency. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
Explain how you would optimize a vector database for sub-100ms query latency at scale.
Discuss the assumptions you would clarify, including vector dimensionality, index size, query volume, filtering requirements, target recall, hardware, and consistency needs. Cover index selection, sharding, replication, caching, compression, filtering, concurrency, and capacity planning. Explain how you would benchmark the system, monitor production behavior, detect recall or latency regressions, and handle failures. Address the tradeoff between approximate nearest-neighbor recall, query latency, memory usage, and infrastructure cost.