wolffd@0: function kl = KLgauss(P, Q) wolffd@0: %The following computes D(P||Q), the KL divergence between two zero-mean wolffd@0: %Gaussians with covariance P and Q: wolffd@0: % klDiv = -0.5*(log(det(P*inv(Q))) + trace(eye(N)-P*inv(Q))); wolffd@0: wolffd@0: R = P*inv(Q); wolffd@0: kl = -0.5*(log(det(R))) + trace(eye(length(P))-R); wolffd@0: wolffd@0: %To get MI, just set P=cov(X,Y) and Q=blockdiag(cov(X),cov(Y)).