Architect a scalable background job processing system that handles rate-limiting and automatic retries for external API integrations.
