Moveworks.AiMediumCoding00:00Welcome to your interview for the Agentic AI Engineer role at Moveworks.Ai.
The question is on your right: Priority Rate Limiter for LLM Calls. Take a moment with it first.
Talk your thinking through with me if you like - when you're confident, submit your answer and I'll grade it like a real screen. You have three graded attempts to score 7/10 or better.
Implement a rate-limiter for downstream LLM API calls that supports priority queuing based on the urgency of the user's request.