Whenever you're ready, walk me through how you'd approach this.
How is evaluation done for such (LLM-based) systems?
Asked in the hiring manager stage. Follow-up on the candidate's project. Explain a practical evaluation strategy for an LLM-based system, including offline and online evaluation, test-set construction, human and model-based judging, monitoring, and failure analysis.