Your question is Chatbot Metrics for Customers. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
If tasked with improving an Amazon Web Services customer service chatbot, what metrics would you focus on, and why?
Explain how you would evaluate response quality, task completion, safety, and customer experience. Discuss trade-offs between automated metrics and human evaluation, and describe how metric results would guide model improvements.
