L1 vs L2 Regularization

Scenario

You are comparing regularized linear models for a supervised learning task and want to explain what changes when you use an L1 penalty versus an L2 penalty.

Question

Explain the difference between L1 and L2 regularization from both a geometric and a Bayesian perspective.