#KL divergence to expected value

1 messages · Page 1 of 1 (latest)

hexed plover
#

$D_{KL}[a||b] = E_a[log \frac{a}{b}]$

serene viperBOT
#

Richienb

hexed plover
#

$-D_{KL}[a||b] + D_{KL}[a||c] = -E_a[log \frac{a}{b}] + E_a[log \frac{a}{c}]$

serene viperBOT
#

Richienb

hexed plover
#

How do I simplify further to this?

#

$= E_a[log \frac{b}{c}]$

serene viperBOT
#

Richienb