annotate toolboxes/FullBNT-1.0.7/KPMtools/entropy.m @ 0:cc4b1211e677 tip

initial commit to HG from Changeset: 646 (e263d8a21543) added further path and more save "camirversion.m"
author Daniel Wolff
date Fri, 19 Aug 2016 13:07:06 +0200
parents
children
rev   line source
Daniel@0 1 function H = entropy(v, scale)
Daniel@0 2 % ENTROPY Entropy log base 2
Daniel@0 3 % H = entropy(v)
Daniel@0 4 % If v is a matrix, we compute the entropy of each column
Daniel@0 5 %
Daniel@0 6 % % H = entropy(v,1) means we scale the result so that it lies in [0,1]
Daniel@0 7
Daniel@0 8 if nargin < 2, scale = 0; end
Daniel@0 9
Daniel@0 10 v = v + (v==0);
Daniel@0 11 H = -1 * sum(v .* log2(v), 1); % sum the rows
Daniel@0 12
Daniel@0 13 if scale
Daniel@0 14 n = size(v, 1);
Daniel@0 15 unif = normalise(ones(n,1));
Daniel@0 16 H = H / entropy(unif);
Daniel@0 17 end