Whenever you're ready, walk me through how you'd approach this.
Compute KL divergence given different random variables.
Assume the variables are discrete and share the same four outcomes. Given probability mass functions P and Q, calculate the forward KL divergence D_KL(P||Q), the reverse divergence D_KL(Q||P), and explain why the two values may differ. Also calculate the Jensen-Shannon divergence as a finite, symmetric comparison.
Requirements:
Assume both probability vectors are valid and contain no zero probabilities.