Design Edge Versus Cloud Inference

Scenario

You are building a product that uses deep learning inference in both mobile or embedded environments and centralized backend services. The same user experience may need to work with intermittent connectivity, limited hardware, and stricter local constraints.

Question

Explain the challenges of deploying deep learning models on edge devices versus cloud infrastructure.