GoogleHardSystem Design00:00Welcome to your interview for the ML Platform Engineer role at Google.
The question is on your right: Dynamic Inference Autoscaler. Take a moment with it first.
Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen. You have three graded attempts to score 7/10 or better.
Design a dynamic resource autoscaler for an inference fleet experiencing highly volatile traffic patterns at Google.