RAG System LLM Calls at Flipkart

HardSystem Design00:00

Practice interviewer

In session

5 left

00:00

Your question is RAG System LLM Calls at Flipkart. Take a moment with it on the right.

Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).

You need to log in / sign up to chat or submit.

Problem

Design and optimise the LLM calls in a RAG system (drawn from the candidate's current work).

This was asked in the AI Design round. The question was based on the candidate's current work, with emphasis on optimising LLM calls in a RAG system.

Explain how you would identify expensive or unnecessary calls, redesign the retrieval and generation flow, and validate that optimisation does not reduce factual grounding. Address caching, batching, model selection, streaming, fallbacks, prompt construction, observability, and online versus offline evaluation. State the measurements you would request before making capacity or cost decisions.