Definition. Jeffreys divergence [ftip-008M]
Definition. Jeffreys divergence [ftip-008M]
For probability laws \(p\) and \(q\) for which both terms are finite, their Jeffreys divergence is
\[ J(p,q) =D_{\mathrm {KL}}(p\Vert q) +D_{\mathrm {KL}}(q\Vert p). \]The KL divergence and its argument order are defined in Definition [ftip-006X]. Unlike either directed term, \(J(p,q)=J(q,p)\). In the finite tilt of Definition [ftip-008K], \(p\) and \(q_r\) have the same support, so both terms are finite.