Design an API gateway and orchestrator for an LLM serving platform that supports streaming responses, request queuing, and priority routing.
