Your question is Scalable Pipeline Service Best Practices. Take a moment with it on the right.
Talk me through your thinking if you like. When you're confident, submit your answer and I'll grade it like a real screen (7/10 or better passes).
You're building pipeline services that need to ingest, transform, and publish data reliably as usage grows. You want to think through the design patterns that keep these services maintainable, observable, and safe to operate.
What are the best practices for developing scalable micro-services?